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PREFACE 


The experiments described in this monograph have been con- 


| ducted jointly by the two authors. The material for the scale and 


all the data were compiled by Mr. Chave who made all arrange- 
ments for conducting the experimental tests. He was also respon- 
sible for supervising the tabulation of the results and he has writ- 
ten chapter vi on “Further Studies of Validity.”” The chapters on 
measurement theory were written by Mr. Thurstone, who is also 
responsible for the statistical methods used. 

We wish to acknowledge the assistance of instructors and 
students who have served as subjects for these experiments by 
filling in the various forms and by sorting the lists of statements of 


‘opinion in various ways. Dean Boucher made it possible to con- 


duct one form of the tests in a Freshman assembly in Mandel Hall 
and Mr. Fred Moore arranged for conducting a similar test at the 
Chicago Forum. Dean Shailer Mathews and Professor T. G. 


_ Soares placed at our disposal certain funds for the. experimental 
and statistical work, and the Local Community Research Com- 
_ mittee at the University of Chicago has also sponsored the proj- 


ect financially. Professor Faris has kindly consented to let us 


reprint sections of an article in the American Journal of Sociology 
(January, 1928) which described the possibility of measuring 
attitude. The studies there described were begun under the 
auspices of the Institute for Juvenile Research. We also wish 
to express our appreciation of the competent statistical work 
of Miss Annette McBroom and Mr. C. W. Brown who have 
been responsible for the statistical work on this monograph. 
We regard the present experiments as preliminary in charac- 
ter, and a second scale for measuring attitude toward the church 
is now in process of construction. It is hoped that it will be rela- 
tively free from the defects which we have found in the present 
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experimental scale. Our main contribution is probably in the idea 
of using the equally-often-noticed difference or, preferably, the 
discriminal error as a unit of measurement for the objective de- 
scription of attitude and opinion. 

E. J. CHAVE 


L. L. THuRSTONE 
UNIVERSITY OF CHICAGO‘ 
April, 1928 
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| MEASUREMENT IN RELIGIOUS EDUCATION 


___ In the processes of religious education one of the most signifi- 
cant factors to be considered is the development or modification 
of attitudes. The goals of modern religious education do not sim- 
ply involve the attainment of certain bodies of knowledge, such 
as the Bible, creeds, and doctrinal statements, history of religions, 
and other records of religious experience but are more closely re- 
lated to the actual behavior of persons in society. To measure the 
amount of knowledge that any pupil may have received is fairly 
easy. The techniques for this kind of measurement are well es- 
‘tablished and it only requires a careful selection of materials to 
construct satisfactory tests. The more important concern of re- 
ligious educators today is to measure how far habits of conduct 
that are in accordance with modern religious ideas have been es- 
‘tablished and how far attitudes and values that express the re- 
ligious tendencies considered to be directed toward the realization 
of the highest good for the individuals themselves and for the 
‘society of which they are members have been developed in in- 
dividuals and in groups of persons. These attitudes involve tend- 
encies toward the institutions of religion—its symbols, its liter- 
ature, its expressed doctrines, its concepts, ideals, programs, and 
other phases of religious living. The attitudes taken by persons 
indicate the values discovered in their personal and social religious 
experience. 

Religious educators have been for many years changing and 
rechanging their methods and materials in their desire to promote 
satisfactory religious habits, attitudes, and values in children, 
youth, and adults. But as in the field of general education, this 
revision has been largely dependent upon guesswork and hopeful 
estimates as to what the results have been and might be. If the re- 
sults could be measured more accurately the processes of religious 
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education could be more intelligently directed and the desired 
effects upon character would be more effectively produced. Even - 
the rough measuring tools that have so far been developed have ; 
aided in the evaluation of methods. Real progress must wait on | 
the development of more accurate and refined objective measuring 
instruments. i 

Religious education is also interested in all social attitudes. In | 
so far as a person has an attitude that is in the direction of the | 
life-goals approved by religious standards, religious education | 
seeks to develop and motivate such with religious faith, purpose, — 
and passion. In so far as the expression of any social attitude may 
reveal a life set in a direction not approved by religious standards, — 
religious education seeks to change the tendency and redirect the © 
life toward the more ideal religious goal. Thus the measurement 
of attitudes is a distinct field of interest for religious educators. 
This study and experiment recorded herein have been undertaken | 
with the recognition of urgent necessity for better tools for obtain- 
ing more accurate data regarding the existing and changing atti- 
tudes in the individuals and groups with which religious education 
works. 

E. J. CHAVE 


] 
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SUMMARY OF THE MEASUREMENT METHOD 


We have tried to devise a method whereby the distribution of 
uttitude of a group on a specified issue may be represented in the 
‘orm of a frequency distribution. The base line represents ideally 
‘he whole range of attitudes from those at one end who are most 
strongly in favor of the issue to those at the other end of the scale 
who are as strongly against it. Somewhere between the two ex- 
cremes on the base line will be a neutral zone representing indif- 
erent attitudes on the issue in question. The ordinates of the 
Tequency distribution represent the relative popularity of each 
uttitude. 

This measurement problem has the limitation which is com- 
non to all measurement, namely, that one can measure only such 
ttributes as can be represented on a linear continuum, such at- 
ributes as volume, price, length, area, excellence, beauty, and so 
on. For the present problem we are limited to those aspects of at- 
itudes for which one can compare individuals by the ‘‘more and 
ess’ type of judgment. For example, we say understandingly 
hat one man is more in favor of prohibition than another, more 
strongly in favor of the League of Nations than another, more 
militaristic than some other, more religious than another. The 
measurement is effected by the indorsement or rejection of state- 
ments of opinion. 

The opinions are allocated to different positions on the base 
ine in accordance with the attitudes which they express. The 
ordinates of the frequency distribution are determined by the fre- 
quency with which each of the scaled opinions is indorsed. The 
center of the whole problem lies in the definition of a unit of meas- 
urement for the base line. The scale is so constructed that two 
ypinions separated by a unit distance on the base line seem to 
jiffer as much in the attitude variable involved as any other two 
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opinions on the scale which are also separated by a unit distance. 
This is the main idea of the present scale construction. 

The true allocation of an individual to a position on an atti- 
tude scale is an abstraction, just as the true length of a chalk line, 
or the true temperature of a room, or the true spelling ability of a 
child is an abstraction. We estimate the true length of a line, the: 
true temperature of a room, or the true spelling ability of a child| 
by means of various indices, and it is a commonplace in measure- | 
ment that all indices do not agree exactly. In allocating an indi- 
vidual to a point on the attitude continuum we may use various) 
indices, such as the opinions that he indorses, his overt acts, and. 
his past history, and it is to be expected that discrepancies will 
appear as the “‘true” attitude of the individual is estimated by 
different indices. The present study is concerned with the alloca- 
tion of individuals along an attitude continuum based on the opin- 
ions that they accept or reject. | 

We are not at all sure that the method we have used is theo-’ 
retically correct or that it is the best psychophysical method of 
measuring attitude. It is possible that the method of equal-ap- 
pearing intervals that we have used in these experiments may be 
superseded by better psychophysical methods. Our main purpose 
will have been achieved, however, if we succeed in directing at 4 
tention to the possibility of measuring attitude as a psychophysi- 
cal problem. In doing so we are but extending the pioneer work 
of Cattell, who was the first to apply psychophysical methods to 
the measurement of social values. 


L. L. THURSTONE 


CHAPTER I 
THEORY OF ATTITUDE MEASUREMENT 


THE OBJECTIVE DESCRIPTION OF ATTITUDE 


The scientific study of social phenomena suffers from the 
serious handicap that the phenomena that we call social are ex- 
ceedingly difficult to describe in objective terms, to say nothing of 
juantitative measurement. Whenever objective or quantitative 
treatment is attempted we not infrequently feel that the very es- 
sence has been squeezed out of the effects that we want to study. 
About this feeling concerning quantitative treatment in the social 
studies two comments may be made. In the first place, when we 
and those aspects of a social phenomenon which lend themselves 
to objective and simple counting, it frequently does happen that 
these things that can be counted are really not essential aspects of 
the social phenomenon under consideration. But, further, there 
is also the possibility that as soon as some intriguing problem of 
social conduct becomes accessible to measurement we are in- 
clined to turn our attention away as though elsewhere must reside 
the essence of that which we regard as vital, human, or important. 
This is really a bad habit. 

Since the application of psychophysical methods to the meas- 
urement of social attitudes contains a certain degree of novelty, it 
may be appropriate to review briefly the setting in which the 
present experiments have grown. The psychophysical methods 
were developed primarily for the purpose of measuring discrimi- 
natory powers with special regard to simple sensory stimuli. The 
classical psychophysical experiments were devoted to the meas- 
urement of the subject’s power to discriminate between lines of 
slightly different length, between slightly different weights that he 
lifted, between pairs of gray papers that differed slightly in bright- 
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ness, and so on. In experiments of this kind were discoverec 
Weber’s law and Fechner’s law. 
Cattell seems to be the first to have extended the psychophys: 
ical methods to stimuli other than simple sensory values. He ap} 
plied the psychophysical procedures with some variations to thé 
measurement of estimated degrees of eminence of scientific menj 
Here, for the first time, the methods were used on stimuli whic 
do not have any simple stimulus magnitude. When the methods 
are used on lifted weights, line lengths, and brightnesses, the ex: 
periments yield two scales. One is a scale of physical stimulus 
magnitude such as the actual weight in grams, the length of the 
lines in centimeters, or the photometrically determined brightness 
of the gray papers. It is known in psychophysics as the R-scale, 
The second scale is the psychological continuum, which is known 
as the S-scale. Its unit is the equally often noticed stimulus dif- 
ference. Fechner’s law describes the logarithmic relation between 
these two scales. Weber’s law describes the average error of per- 
ception as a constant fraction of the physical stimulus magnitude. 
When Cattell extended the use of these methods to social stimuli 
he constructed, in effect, a psychological scale, the unit of meas- 
urement for which was the equally often noticed difference or 
some approximation to it. 
But when the methods are used for measuring social values 
there is no simple physical stimulus value to be measured such ai 
line length or weight. The validity of the psychological scale i 
equally often noticed differences must be established by other 
criteria of internal consistency. Cattell’s students have applied 
the same methods with variations and short cuts to the measure- 
ment of other social values, examples of which are the experiments 
of Wells in measuring literary merit and the experiments o 
Thorndike in measuring the estimated excellence of handwriting 
and of children’s drawings. The idea underlying such measure- 
ment is the equally often noticed difference, properly defined, as a 
unit of measurement. In all of these measurements, however, 
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there is no simple physical stimulus scale with which to match the 
psychological scale. Hence in these experiments the verification 
at Fechner’s law is not an issue. 

The last twenty years have witnessed a most peculiar separa- 
tion into two groups of the men primarily interested in psychologi- 
cal measurement. One of these groups concern themselves with 
traditional psychophysics with primary emphasis on simple sen- 
sory stimuli. They are the psychophysicists. They have devel- 
oped the psychophysical methods with considerable refinement, 
inspired by an interest in psychological measurement theory. The 
other group has proceeded with the construction of educational 
scales with little or no interest in the available psychophysical 
methods or their underlying theory. As a consequence there is at 
present a wide but artificial break between the group of men who 
work in psychophysics with the traditional stimuli and those who 
attempt to measure educational and social values with little in- 
3 in psychophysical theory. The present study is one of a 


series of experiments intended to continue the work of Cattell in 
applying the psychophysical methods to the measurement of 
ocial values. It is our hope again to unify the efforts to measure 
focal values with the advancement in psychophysical theory. 
We have used the method of equal-appearing intervals for the 
construction of our scale of attitude. There is some question 
about the validity of this method since the scale so produced may 
not be entirely consistent with the scale that would be produced 
y the method of paired comparison or Cattell’s order of merit 
rank order) procedure. We leave it for separate experimentation, 
owever, to ascertain to what extent the psychological scales dif- 
er when they are produced by the several psychophysical meth- 
ds. 

Before proceeding to describe our experiments and the termi- 
nology and methods that are involved, it may be in order to de- 
scribe first the ultimate purposes of the measuring tools that we 
re here attempting to develop. What might such a tool be used 
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for? Perhaps such a question is better answered after a more 
detailed description of our procedures, but it will be discussed here 
in order to give as practical a slant as may be possible to the ex- 
periments that we have undertaken. 
Assume that we want to know which form of appeal is most 
effective for making people change their minds about a disputed, 
issue such as pacifism, prohibition, municipal ownership, birth 
control, feminism, on which people differ both as regards the ac- 
tual convictions which they more or less frankly declare and also: 
as regards the emotional load with which the convictions are ad- - 
hered to. Would it be more effective to make an appeal to a speci- 
fied kind of audience by presenting facts in favor of one side of 
the issue or to present an emotional or oratorical address on the 
subject? The outcome would supposedly differ with the kind of 
audiénce on which the experiment was performed. 
If we really want to answer such a question with any pare 
ticular specifications as to the issue, the two types of appeal to b 
evaluated, the education, sex, and occupation of the audience, ond 
so on, we should want to evaluate first the distribution of attitudes 
in our audience before the appeal is made, and then evaluate if 
after the appeal has been made. A comparison between the dis~ 
tributions of attitudes before and after the presentation of the lec . 
ture or reading matter would constitute the natural basis on which. 
we should decide as to which of the two types of appeal would be 
the more effective in making these people change their minds. But 
how shall the distribution of attitudes or opinions be measured? 
That is the main problem of the present investigation. 
Another situation that arises frequently enough is that of 
comparing two groups of people in different localities as to just 
how strongly they feel on some disputed issue. Of course it is pos= 
sible merely to present a simple proposition on which the two 
groups vote “‘yes” or “no,” and the total votes on the single prop= 
osition would indicate in a simple but crude way how the two 
groups feel about the question. But such a total vote does noi 
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or against the proposition in the two groups, nor does it indicate 
just how a proposition might be presented in order to command 
a majority acceptance. If we had a graded series of propositions 
ranging from one extreme of the issue to the other, then we could 
present the whole list to the two groups for separate indorsement 
of each proposition. This is not suggested for popular elections in 
which the present study has no immediate concern. 

_ On the basis of the resulting tabulations it might be desirable 
to make a comparison of the two groups by saying that on the 
average one of them was more strongly in favor of the proposition 
than the other. But what is the average of the indorsements of a 
list of propositions? That question could be answered only if the 
graded propositions could be assigned to a linear continuum of 
some sort. Then it would be possible to locate the central tend- 
ency of the frequency distributions of attitude in the groups, and 
thereby to compare them by a single index. In the same manner 
the two groups could be compared as to the dispersions of attitude 
which they represented only in case a measure of dispersion could 
be applied to the votes on the list of propositions. A linear contin- 
uum is requisite also for the solution of this problem. Our main 
problem here concerns the possibility of measuring attitudes in 
such a manner. 


| 
ndicate the relative frequency of extreme convictions either for 
| 


THE POSSIBILITY OF MEASURING ATTITUDE’ 

The very fact that one offers a solution to a problem so com- 
plex as that of measuring differences of attitude on disputed social 
issues makes it evident from the start that the solution is more or 
less restricted in nature and that it applies only under certain as- 
sumptions that will, however, be described. In devising a method 
of measuring attitude we have tried to get along with the fewest 
possible restrictions because sometimes one is tempted to disre- 

« Sections of this monograph are reprinted, with permission of the editors, from 


L. L. Thurstone, ‘Attitudes Can Be Measured,” American Journal of Sociology, 
January, 1928. 
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gard so many factors that the original problem disappears. We 
trust that we shall not be accused of throwing out the baby with 
its bath. 

In promising to measure attitudes we shall make several com- 
mon-sense assumptions that will be stated here at the outset so 
that subsequent discussion may not be fogged by confusion re- 
garding them. If the reader is unwilling to grant these assump- 
tions, then we shall have nothing to offer him. If they are granted, 
we can proceed with some measuring methods that ought to yield 
interesting results. 

It is necessary to state at the very outset just what we shall 
here mean by the terms “‘attitude” and “opinion.” This is all the 
more necessary because the natural first impression about these 
two concepts is that they are not amenable to measurement in any 
real sense. It will be conceded at the outset that an attitude is a 
complex affair which cannot be wholly described by any single 
numerical index. For the problem of measurement this statement 
is analogous to the observation that an ordinary table is a complex 
affair which cannot be wholly described by any single numerical 
index. So is a man such a complexity which cannot be wholly rep- 
resented by a single index. Nevertheless we do not hesitate to say 
that we measure the table. The context usually implies what it is 
about the table that we propose to measure. We say without 
hesitation that we measure a man when we take some anthropo- 
metric measurements of him. The context may well imply with- 
out explicit declaration what aspect of the man we are measuring, 
his cephalic index, his height, or weight, or what not. Just in the 
same sense we shall say here that we are measuring attitudes. We 
shall state or imply by the context the aspect of people’s attitudes 
that we are measuring. The point is that it is just as legitimate to 
say that we are measuring attitudes as it is to say that we are 
measuring tables or men. 

The concept “attitude’”’ will be used here to denote the sum- 
total of a man’s inclinations and feelings, prejudice or bias, pre- 
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onceived notions, ideas, fears, threats, and convictions about any 
pecific topic. Thus a man’s attitude about pacifism means here 
ll that he feels and thinks about peace and war. It is admittedly 
subjective and personal affair. 

The concept “opinion” will here mean a verbal expression of 
ttitude. If a man said that we made a mistake in entering the 
var against Germany, that statement would be called his opinion. 
“he term ‘‘opinion”’ will be restricted to verbal expression. But it 
; an expression of what? It expresses an attitude, supposedly. 
“here should be no difficulty in understanding this use of the two 
erms. The verbal expression is the opinion. Our interpretation 
f such an expressed opinion would be that the man’s attitude is 
ro-German. An opinion symbolizes an attitude. 

Our next point concerns what it is that we want to measure. 
Vhen a man says that we made a mistake in entering the war with 
yermany, the thing that interests us is not really the string of 
yords as such or even the immediate meaning of the sentence 
1erely as it stands, but rather the attitude of the speaker, the 
houghts and feelings of the man about the United States, and 
he war, and Germany. It is the attitude that really interests us. 
‘he opinion has interest only in so far as we interpret it as a sym- 
ol of attitude. It is therefore something about attitudes that 
re want to measure. We shall use opinions as the means for 
veasuring attitudes. 

There comes to mind the uncertainty of using an opinion as 
n index of attitude. The man may bea liar. If he is not inten- 
ionally misrepresenting his real attitude on a disputed question, 
e may nevertheless modify the expression of it for reasons of 
ourtesy, especially in those situations in which frank expression 
f attitude may not be well received. This has led to the sugges- 
on that a man’s action is a safer index of his attitude than what 
e says. But his actions may also be distortions of his attitude. A 
olitician extends friendship and hospitality in overt action while 
iding an attitude that he expresses more truthfully to an intimate 
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friend. Neither his opinions nor his overt acts constitute in any 
sense an infallible guide to the subjective inclinations and prefer- 
ences that constitute his attitude. Therefore we must remain con- 
tent to use opinions or other forms of action merely as indices of 
attitude. It must be recognized that there is a discrepancy, some 
error of measurement as it were, between the opinion or overt ac- 
tion that we use as an index and the attitude that we infer from 
such an index. | 

But this discrepancy between the index and “truth” is uni- 
versal. When you want to know the temperature of your room, 
you look at the thermometer and use its reading as an index of 
temperature just as though there were no error in. the index and 
just as though there were a single temperature reading which is 
the “correct” one for the room. If it is desired to ascertain the 
volume of a glass paperweight, the volume is postulated as an 
attribute of the piece of glass, even though volume is an abstrac- 
tion. The volume is measured indirectly by noting the dimensions 
of the glass or by immersing it in water to see how much water it 
displaces. These two procedures give two indices which may not 
agree exactly. In almost every situation involving measurement 
there is postulated an abstract continuum such as volume or 
temperature, and the allocation of the thing measured to that 
continuum is accomplished usually by indirect means through one 
or more indices. Truth is inferred only from the relative consist- 
ency of the several indices, since it is never directly known. We 
are dealing with the same type of situation in attempting to meas- 
ure attitude. We must postulate an attitude variable which is like 
practically all other measurable attributes in the nature of an ab- 
stract continuum, and we must find one or more indices which will 
satisfy us to the extent that they are internally consistent. 

In the present study we shall measure the subject’s attitude as 
expressed by the acceptance or rejection of opinions. But we shall 
not thereby imply that he will necessarily act in accordance with 
the opinions that he has indorsed. Let this limitation be clear. 
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he measurement of attitudes expressed by a man’s opinions does 
ot necessarily mean the prediction of what he will do. If his ex- 
ressed opinions and his actions are inconsistent, that does not 
oncern us now, because we are not setting out to predict overt 
onduct. We shall assume that it is of interest to know what peo- 
le say that they believe even if their conduct turns out to be in- 
msistent with their professed opinions. Even if they are inten- 
onally distorting their attitudes, we are measuring at least the 
ttitude which they are trying to make people believe that they 
ave. 

We take for granted that people’s attitudes are subject to 
hange. When we have measured a man’s attitude on any issue 
ich as pacifism, we shall not declare such a measurement to be 
1 any sense an enduring or constitutional constant. His attitude 
1ay change, of course, from one day to the next, and it is our task 
) measure such changes, whether they be due to unknown causes 
r to the presence of some known persuasive factor, such as the 
sading of a discourse on the issue in question. However, such 
uctuations may also be attributed in part to error in the meas- 
rements themselves. In order to isolate the errors of the meas- 
rement instrument from actual fluctuations in attitude, we must 
alculate the standard error of measurement of the scale itself, 
nd this can be accomplished by methods already well known in 
ental measurement. 

We shall assume that an attitude scale is used only in those 
tuations in which one may reasonably expect people to tell the 
‘uth about their convictions or opinions. If a denominational 
shool were to submit to its students a scale of attitudes about the 
hurch, one might find that some students hesitate to make known 
1eir convictions if they deviate from the orthodox beliefs of their 
shool. At least, the findings could be challenged if the situation 
1 which attitudes were expressed contained pressure or implied 
ireat bearing directly on the attitude to be measured. Similarly, 
would be difficult to discover attitudes on sex liberty by a writ- 
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situations that offer a minimum of pressure on the attitude to be | 
measured. Such situations are common enough. i 
All that we can do with an attitude scale is to measure the} 


problem to interpret in each case the extent to which the subjects. 
have expressed what they really believe. All that we can do is to 
minimize as far as possible the conditions that prevent our sub- 
jects from telling the truth, or else to adjust our interpretations 
accordingly. 

When we discuss opinions, about prohibition for example, we | 
quickly find that these opinions are multidimensional, that they | 
cannot all be represented in a linear continuum. The various | 
opinions cannot be completely described merely as “more’’ or i 
“less.” They scatter in many dimensions, but the very idea of | 
measurement implies a linear continuum of some sort such as | 
length, price, volume, weight, age. When the idea of measure- | 
ment is applied to scholastic achievement, for example, it is neces- | 
sary to force the qualitative variations into a scholastic linear 
scale of some kind. We judge in a similar way qualities such as | 
mechanical skill, the excellence of handwriting, and the amount of 
a man’s education, as though these traits were strung out along | 
a single scale, although they are, of course, in reality scattered in 
many dimensions. As a matter of fact, we get along quite well 
with the concept oi a linear scale in describing traits even so quali- 
tative as education, social and economic status, or beauty. A 
scale or linear continuum is implied when we say that a man has | 
more education than another, or that a woman is more beautiful 
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han another, even though, if pressed, we admit that perhaps the 
air involved in each of the comparisons have little in common. 
‘ is clear that the linear continuum which is implied in a ‘more 
ind less” judgment may be conceptual, that it does not neces- 
sarily have the physical existence of a yardstick. 
| And so it is also with attitudes. We do not hesitate to compare 
chem by the “‘more and less” type of judgment. We say about a 
nan, for example, that he is more in favor of prohibition than 
some other, and the judgment conveys its meaning very well with 
he implication of a linear scale along which people or opinions 
night be allocated. 


THE ATTITUDE VARIABLE 


The first restriction on the problem of measuring attitudes is 
0 specify an attitude variable and to limit the measurement to 
hat. An example will make this clear. Let us consider the pro- 
uibition question and let us take as the attitude variable the de- 
sree of restriction that should be imposed on individual liberty in 
he consumption of alcohol. This degree of restriction can be 
hought of as a continuum ranging from complete and absolute 
reedom or license to equally complete and absolute restriction, 
ind it would of course include neutral and indifferent attitudes. 
| In collecting samples from which to construct a scale we might 
isk a hundred individuals to write out their opinions about pro- 
uibition. Among these we might find one which expresses the 
yelief that prohibition has increased the use of tobacco. Surely 
his is an opinion concerning prohibition, but it would not be at all 
erviceable for measuring the particular attitude variable on pro- 
ibition mentioned in the foregoing. Hence it would be irrele- 
vant. Another man might express the opinion that prohibition 
1as eliminated an important source of government revenue. This 
s also an opinion concerning prohibition, but it would not belong 
o the particular attitude variable that we have set out to measure 
rr scale. It is preferable to use an objective and experimental 
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criterion for the elimination of opinions that do not belong on the 
specified continuum to be measured, and we believe that such a 
criterion is available. 

This restriction on the problem of measuring attitudes is nec- 
essary in the very nature of measurement. It is taken for granted 
in all ordinary measurement, and it must be clear that it applies 
also to measurement in a field in which the multidimensional char- 
acteristics have not yet been so clearly isolated. For example, it’ 
would be almost ridiculous to call attention to the fact that a 
table cannot be measured unless one states or implies what it is 
about the table that is to be measured; its height, its cost, or 
beauty, or degree of appropriateness, or the length of time re-— 
quired to make it. The context usually makes this restriction on 
measurement. When the notion of measurement is applied to so 
complex a phenomenon as opinions and attitudes, we must here 
also restrict ourselves to some specified or implied continuum 
along which the measurement is to take place. 

In specifying the attitude variable, the first requirement is 
that it should be so stated that one can speak of it in terms of 
“more” and “less,” as, for example, when we compare the atti- 
tudes of people by saying that one of them is more pacifistic, more 
in favor of prohibition, more strongly in favor of capital punish- 
ment, or more religious than some other person. 

Figure 1 represents an attitude variable, militarism-pacifism, 
with a neutral zone. A person who usually talks in favor of pre- 
paredness, for example, would be represented somewhere to the 
right of the neutral zone. A person who is more interested in dis- 
armament would be represented somewhere to the left of the neu- 
tral zone. It is possible to conceive of a frequency distribution to 
represent the distribution of attitude in a specified group on the 
subject of pacifism-militarism. 

Consider the ordinate of the frequency distribution at any 
point on the base line. The point and its immediate vicinity rep- 
resent for our purpose an attitude, and we want to know relatively 
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ow common that degree of feeling for or against pacifism may be 
n the group that is being studied. It is of secondary interest to 
now that a particular statement of opinion is indorsed by a cer- 
ain proportion of that group. It is only to the extent that the 
pinion is representative of an attitude that it is useful for our 
urposes. Later we shall consider the possibility that a statement 
f opinion may be scaled as rather pacifistic and yet be indorsed 
y a person of very pronounced militaristic sympathies. To the 
xtent that the statement is indorsed or rejected by factors other 
han the attitude variable that it represents, to that extent the 


AI Ee Neutral Extreme 
acitis(n | Militarisia 


Fic. 1 


ratement is useless for our purposes. We shall also consider an 
bjective criterion for spotting such statements so that they may 
e eliminated from the scale. In our entire study we shall be 
ealing, then, with opinions, not primarily because of their cogni- 
ve content but rather because they serve as the carriers or sym- 
ols of the attitudes of the people who express or indorse these 
pinions. 

There is some ambiguity in using the term attitude in the 
lural. An attitude is represented as a point on the attitude con- 
nuum. Consequently there is an infinite number of attitudes 
1at might be represented along the attitude scale. In practice, 
owever, we do not differentiate so finely. In fact, an attitude, 
ractically speaking, is represented by a certain narrow range or 


| 
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vicinity on the scale. When a frequency distribution is drawn for 


any continuous variable, such as stature, we classify the variable 
for descriptive purposes into steps, or class-intervals. The atti- © 
tude variable can also be divided into class-intervals and the™ 
frequency counted in each class-interval. When we speak of “an” 
attitude, we shall refer to a point, or restricted range, on the atti- 
tude continuum. Several attitudes will be considered not as a set 
of discrete entities but as a series of class-intervals along the atti- 


tude scale. 


i 
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A FREQUENCY DISTRIBUTION OF ATTITUDES 


The main argument so far has been to show that since in ordi- 
nary conversation we readily and understandably describe indi- 
viduals as more and less pacifistic or more and less militaristic in 
attitude, we may frankly represent this linearity in the form of a 
unidimensional scale. This has been done in a diagrammatic way 
in Figure 1. We shall first describe our objective and then show 
how a rational unit of measurement may be adopted for the whole 
scale. 

Let the base line of Figure 1 represent a continuous range of 
attitudes from extreme pacifism on the left to extreme militarism ~ 
on the right. If the various steps in such a scale were defined, it is 
clear that a person’s attitude on militarism-pacifism could be 
represented by a point on that scale. The strength and direction 
of a particular individual’s sympathies might be indicated by the 
point a, thus showing that he is rather militaristic in his opinions. 
Another individual.might be represented at the point 6 to show 
that although he is slightly militaristic in his opinions, he is not so 
extreme about it as the person who is placed at the point a. A 
third person might be placed at the point ¢ to show that he is quite 
militaristic and that the difference between a and c is very slight. 
A similar interpretation might be extended to any point on the 
continuous scale from extreme militarism to extreme pacifism, 
with a neutral or indifference zone between them. 
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| A second characteristic might also be indicated graphically in 
terms of the scale, namely, the range of opinions that any particu- 
ig individual is willing to indorse. It is of course not to be ex- 
pected that every person will find only one single opinion on the 
whole scale that he is willing to indorse and that he will reject all 
the others. As a matter of fact we should probably find ourselves 
willing to indorse several opinions within a certain range of the 
Suc. It is conceivable, then, that a pacifistically inclined person 
would be willing to indorse all or most of the opinions in the range 
d to e and that he would reject as too extremely pacifistic most of 
the opinions to the left of d, and would also reject the whole range 
of militaristic opinions. His attitude would then be indicated by 
the average or mean of the range that he indorses, unless he cares 
to select a particular opinion which most nearly represents his own 
attitude. The same sort of reasoning may of course be extended 
to the whole range of the scale, so that we should have at least 
two, or possibly three, characteristics of each person designated 
in terms of the scale. These characteristics would be (1) the mean 
position that he occupies on the scale; (2) the range of opinions 
that he is willing to accept, and (3) that one opinion which he 
selects as the one which most nearly represents his own attitude 
on the issue at stake. 

It should also be possible to describe a group of individuals by 
means of the scale. This type of description has been represented 
in a diagrammatic way by the frequency outline. 

Any ordinate of the curve represents the number of individ- 
uals, or the percentage of the whole group, that indorses the cor- 
responding opinion. For example, the ordinate at b represents the 
number of persons in the group who indorse the degree of milita- 
rism indicated by the point bd on the scale. A glance at the fre- 
quency curve shows that for the fictitious group of this diagram 
militaristic opinions are indorsed more frequently than the paci- 
fistic ones. It is clear that the area of this frequency diagram rep- 
resents the total number of indorsements given by the group. The 
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diagram can be arranged in several different ways that will be 
separately discussed. It is sufficient at this moment to realize 
that, given a valid scale of opinions, it would be possible to com- 
pare several different groups in their attitudes on a disputed 
question. 

A second type of group comparison might be made by the ~ 
range or spread that the frequency surfaces reveal. If one of the 
groups is represented by a frequency diagram of considerable 
range or scatter, then that group would be more heterogeneous on — 
the issue at stake than some other group whose frequency diagram : 
of attitudes shows a smaller range or scatter. It goes without say- _ 
ing that the frequent assumption of a normal distribution in edu- | 
cational scale construction has absolutely no application here, be- — 
cause there is no reason whatever to assume that any group of © 
people will be normally distributed in their opinions about any- | 
thing. 

It should be possible, then, to make four types of description | 
by means of a scale of attitudes. These are (r) the average or | 
mean attitude of a particular individual on the issue at stake; (2) 
the range of opinion that he is willing to accept or tolerate; (3) the ~ 
relative popularity of each attitude of the scale for a designated 
group as shown by the frequency distribution for that group, and ~ 
(4) the degree of homogeneity or heterogeneity in the attitudes of 
a designated group on the issue, as shown by the spread or disper- 
sion of its frequency distribution. 

This constitutes our objective. The heart of the problem is 
in the unit of measurement for the base line, and it is to this aspect © 
of the problem that we may now turn. 


CM tins ore 
ar 


A UNIT OF MEASUREMENT FOR ATTITUDES 


The only way in which we can identify the different attitudes 
(points on the base line) is to use a set of opinions as landmarks, as 
it were, for the different parts or steps of the scale. The final scale 
will then consist of a series of statements of opinion, each of which 
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is allocated to a particular point on the base line. If we start with 
enough statements, we may be able to select a list of forty or fifty 
opinions so chosen that they represent an evenly graduated series 
of attitudes. The separation between successive statements of 
opinion would then be uniform, but the scale can be constructed 
with a series of opinions allocated on the base line even though 
their base line separations are not uniform. For the purpose of 
drawing frequency distributions it will be convenient, however, to 
have the statements so chosen that the steps between them are 
uniform throughout the whole range of the scale. 
_ Consider the three statements, a, c, and d, in Figure 1. The 
statements c and a are placed close together to indicate that they 
are very similar, while statements c and d are spaced far apart to 
indicate that they are very different. We should expect two in- 
dividuals scaled at c and a, respectively, to agree very well in dis- 
cussing pacifism and militarism. On the other hand, we should ex- 
pect to be able to tell the difference quite readily between the 
opinions of a person at d and another person at c. The scale sepa- 
rations of the opinions must agree with our impressions of them. 
In order to ascertain how far apart the statements should be 
on the final scale, one method, the method used in our experi- 
ment, is to submit them to a group of several hundred people who 
jare asked to arrange the statements in order from the most paci- 
ffistic to the most militaristic. We do not ask them for their own 
opinions. That is another matter entirely. We are now concerned 
‘with the construction of a scale with a valid unit of measurement. 
/There may be a hundred statements in the original list, and the 
\several hundred persons are asked merely to arrange the state- 
jments in rank order according to the designated attitude variable. 
\It is then possible to ascertain the proportion of the readers who 
iconsider statement a to be more militaristic than statement c. If 
ithe two statements represent very similar attitudes we should not 
jexpect to find perfect agreement in the rank order of statements 
a and c. If they are identical in attitude, there will be about 50 
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tic than statement c, while the remaining 50 per cent of the read- | 
ers will say that statement c is more militaristic than statement a.— 
It is possible to use the proportion of readers or judges who agree | 
about the rank order of any two statements as a basis for actual » 
measurement. : 

If go per cent of the judges or readers say that statement a is” 
more militaristic than statement b (f,>5=0.90) and if only 60 : 
per cent of the readers say that statement a is more militaristic 
than statement c (p.>,=0.60) then clearly the scale separation © 
(a—c) is shorter than the scale separation (a—b). The psycholog- 
ical scale separation between any two stimuli can be measured in 
terms of a law of comparative judgment.' 

The practical outcome of this procedure is a series of state-— 
ments of opinion allocated along the base line of Figure 1. The > 
interpretation of the base-line distances is that the apparent dif-~ 
ference between any two opinions will be equal to the apparent — 
difference between any other two opinions which are spaced equal- 
ly far apart on the scale. In other words, the shift in opinion rep- 
resented by a unit distance on the base line seems to most people 
the same as the shift in opinion represented by a unit distance at 
any other part of the scale. Two individuals who are separated by 
any given distance on the scale seem to differ in their attitudes as” 
much as any other two individuals with the same scale separation. 
In this sense we have a truly rational base line, and the frequency 
diagrams erected on such a base line are capable of legitimate in- 
terpretation as frequency surfaces.” 


«For a more detailed discussion of this law see L. L. Thurstone, “The Law of 
Comparative Judgment,” Psychological Review, July, 1927. The logic of the psycho 
logical S-scale is discussed in L. L. Thurstone, ““Psychophysical Analysis,”’ American 
Journal of Psychology, July, 1927. 


2 A detailed application of the law of comparative judgment to a related prob 
lem in attitude measurement is described in L. L. Thurstone, ‘An Experimenta 
Study of Nationality Preferences,” Journal of General Psychology, I (July-— 
October, 1928). 
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In contrast with such a rational base line or scale is the simpler 
srocedure of merely listing from ten to twenty opinions, arranging 
hem in rank order by a few readers, and then merely counting the 
1umber of indorsements for each statement. That can of course 
ye done provided that the resulting diagram is not interpreted as a 
requency distribution of attitude. If so interpreted the diagram 
‘an be made to take any shape we please by merely adding new 
tatements or eliminating some of them, arranging the resulting 
ist in rank order evenly spaced on the base line. Allport’s dia- 
rams of opinions’ are not frequency distributions. They should 
ye considered as bar-diagrams in which is shown the frequency 
vith which each of a number of statements is indorsed. Allport’s 
yioneering studies in this field should be read by every investi- 
ator of this problem. Our own interest in the possibility of meas- 
ne attitude by means of opinions was started by Allport’s 


The ideal unit of measurement for the scale of attitudes is 
hhe standard deviation of the dispersion projected on the psycho- 
yhysical scale of attitudes by a statement of opinion, chosen as a 
tandard. It is a matter of indifference which statement is chosen 
s a standard, since the scales produced by using different state- 
ents as standards will have proportional scale-values. This men- 
] unit of measurement is roughly comparable to, but not identi- 
al with, the so-called ‘“‘just noticeable difference’ in psychophys- 
ir measurement.” In the present experimental study another 
| 


nit of measurement was used which will be subsequently de- 
cribed. 
The reason why this ideal unit of measurement, the discrim- 
tFloyd H. Allport, and D. A. Hartman, ‘Measurement and Motivation of 
typical Opinion in a Certain Group,” American Political Science Review, XIX 
:925), 735-60. 
| ?L.L. Thurstone, “A Mental Unit of Measurement,” Journal of Educational 


sychology, May, 1927; ‘Equally Often Noticed Differences,”’ Psychological Review, 
‘ovember, 1927. 
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inal error, could not be used inthe present study is as follows 
The law of comparative judgment can be used in two way 
neither of which was directly applicable to the present problem fot 
practical rather than for logical reasons. One of these methods is 
to submit all of the stimuli, in pairs, to the subjects for judgment, 
Each one of the stimuli is submitted to every subject in combi 
nation with every other stimulus in the whole series. For exampl 
two statements would be given to the subject with the request 
that he indicate which of them is more in favor of the church) 
When all of the subjects have made their judgments about this 
pair of statements we can ascertain the proportion, pa>», of the 
subjects who think that statement a is more strongly in favor of 
the church than statement b. 

This can of course be done but the task becomes prohibitive, 
practically, in two ways. In the first place the subjects would be 
fatigued or bored if they had to make this type of judgment for 


n(n—1) _130X 


129 _ 
2 2 = 8,385 


pairs of statements, each pair requiring careful reading. | 

In the second place the statistical labor required to determine 
the scale-values would also be prohibitive although it is more con: 
ceivable than to ask several hundred individuals to read 8,38: 
pairs of statements. | 

When the stimuli are more easily and quickly judged than the 
comparison of two statements, the law of comparative judgme 
can be readily applied. For example, when the stimuli consist of: 
pairs of nationalities in which the subject is asked only to under! 
line the nationality that he would in general prefer to associat 
with, or when the stimuli consist of handwriting specimens pre 
sented in pairs so that the subject need only check that specimen 
which seems the more excellent, then the procedure is not sO) 
fatiguing. 

The usual psychophysical problem does not involve so man! : 
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imuli in each series and the number of judgments is thereby 
duced to a more reasonable magnitude. The statistical labor is 
iso reduced to proportions more easily handled when the stimu- 
is series is not so long. 

Another procedure for the law of comparative judgment is to 
sk the subject to sort all of the specimens in a series in rank order. 
Jhen the psychophysical series is much shorter, from fifteen to 
wenty or even forty, then the task of arranging the stimuli in 
ink order is not so forbidding. But when the stimulus series con- 
sts of 130 statements, most of which must be read every time 
1e subject looks at them for sorting into a rank order, the task 
ecomes unwieldy. Furthermore, the statistical procedures re- 
uired to extract the proportions, ~.>5, for every possible pair 
f stimuli from absolute rank order data is very laborious. 

For these practical reasons it was advisable to use another 
sychophysical method in the construction of our attitude scale. 
Je decided to use the method of equal-appearing intervals which 
as long been in use in psychophysical experimentation. The de- 
uiled experimental application of this method to the construction 
f our attitude scale will now be described. 


CHAPTER II 
CONSTRUCTION OF AN ATTITUDE SCALE 


COLLECTION OF OPINIONS FOR THE SCALE 


Several groups of people and many individuals were asked to” 
write out their opinions about the church, and current literature” 
was searched for suitable brief statements that might serve the’ 
purposes of the scale. By editing such material a list of 130 state-" 
ments was prepared, expressive of attitudes covering as far as” 
possible all gradations from one end of the scale to the other. 

It was sometimes necessary to give special attention to the 
neutral statements. If a random compilation of statements of 
opinion should fail to produce neutral statements, there is some 
danger that the scale will break in two parts. The whole range 
of attitudes must be fairly well covered, as far as one can tell by 
preliminary inspection, in order to insure that there will be over- 
lapping in the rank orders of different readers throughout the 
scale. 

In making the initial list of statements several practical cri- 
teria were applied in the first editing work. Some of the important 
criteria are as follows: (1) The statements should be as brief as 
possible so as not to fatigue the subjects who are asked to read the 
whole list. (2) The statements should be such that they can be 
indorsed or rejected in accordance with their agreement or dis- 
agreement with the attitude of the reader. Some statements in a 
random sample will be so phrased that the reader can express no 
definite indorsement or rejection of them. (3) Every statement 
should be such that acceptance or rejection of the statement does 
indicate something regarding the reader’s attitude about the issue 
in question. If, for example, the statement is made that war is an 
incentive to inventive genius, the acceptance or rejection of it 
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really does not say anything regarding the reader’s pacifistic or 
militaristic tendencies. He may regard the statement as an un- 
questioned fact and simply indorse it as a fact, in which case his 
answer has not revealed anything concerning his own attitude on 
the issue in question. However, only the conspicuous examples of 
this effect should be eliminated by inspection, because an objec- 
tive criterion is available for detecting such statements so that 
‘their elimination from the scale will be automatic. Personal judg- 
ment should be minimized as far as possible in this type of work. 
(4) Double-barreled statements should be avoided except possibly 
as examples of neutrality when better neutral statements do not 
‘seem to be readily available. Double-barreled statements tend to 
have a high ambiguity. (5) One must insure that at least a fair 
‘majority of the statements really belong on the attitude variable 
that is to be measured. If a small number of irrelevant statements 
should be either intentionally or unintentionally left in the series, 
‘they will be automatically eliminated by an objectivé criterion, 
but the criterion will not be successful unless the majority of the 
statements are clearly a part of the stipulated variable. 
| The following is a list of the 130 statements about the church 
with which we began our experiments. The numbering is quite 
arbitrary and serves only for the purpose of identifying the state- 
‘ments in the various tables and diagrams. 


LIST OF OPINIONS ABOUT THE CHURCH 


1. I have seen no value in the church. 

2. I believe the modern church has plenty of satisfying interests for young 
people. 

3. I do not hear discussions in the church that are scientific or practical 
and so I do not care to go. 

4. I believe that membership in a good church increases one’s self-respect 
and usefulness. 

5. I believe a few churches are trying to keep up to date in thinking and 
methods of work, but most are far behind the times. 

6. I regard the church as an ethical society promoting the best way of liv- 
ing for both an individual and for society. 


24 


Il. 


21. 


22. 


235 


24. 


Dist 
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. The paternal and benevolent attitude of the church is quite distasteful 


to me. 


. I believe the church has a good influence on the lower and uneducated — 


classes but has no value for the upper, educated classes. 


. I don’t believe church-going will do anyone any harm. 
. L have no interest in the church for my parents had no religion and I 


have seen no value in it. 
I believe in the church and its teachings because I have been accus- 
tomed to them since I was a child. 


. I feel the churches are too narrow-minded and clannish. 

. I believe in religion but I seldom go to church. 

. I think the church allows denominational differences to appear larger 
-than true religion. 

. I think the church is a good thing. I don’t go much myself but I like my 


children to go. 


. I get no satisfaction from going to church. 

. In the church I find my best companions and express my best self. 

. Iam an atheist and have no use for the church. 

. I feel church attendance is a fair index of the nation’s morality. 

. I go to church because I enjoy music. I am in the choir and get musical 


training and chorus-singing. 

I do not understand the dogmas or creeds of the church but I find that 
the church helps me to be more honest and creditable. 

I believe in personal religion but organized religion as represented in the 
church has no meaning for me. 

I am interested in a church that is beautiful and that emphasizes the 
aesthetic side of life. 

The churches may be doing good and useful work but they do not in- 
terest me. 

I believe the churches are doing far more harm than good. 

I regard the church today as primarily an educational institution. 

I believe in sincerity and goodness without any church ceremonies. 

I believe in what the church teaches but with mental reservations. 

My only interest in the church is in the opportunities it gives for a good 
time. 

I believe the church ought to have a value but I regret that I have to 
quit it as it is. 

I believe the church promotes a fine brotherly relationship between peo- 
ple and nations. 


32. 


33- 
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I believe the church is bound hand and foot by money interests and can- 
not practice the religion of Jesus. 

I feel the church is petty, always quarreling over matters that have no 
interest or importance. 


. Sometimes I feel that the church and religion are necessary and some- 


times I doubt it. 


. I go to church because my girl does. 
. I believe the churches are too much divided by factions and denomina- 


tions to be a strong force for righteousness. 


. I am only interested in the church for the sake of the social life I find 


there. 


. I think too much money is being spent on the church for the benefit that 


is being derived. 


. I believe the church is absolutely needed to overcome the tendency to 


individualism and selfishness. It practices the golden rule fairly well. 


. I think the teaching of the church is altogether too superficial to have 


much social significance. 


. I think the country would be better off if the churches were closed and 


ministers set to some useful work. 


. I believe the church provides most of the leaders for every movement 


for social welfare. 


. I believe the church represents outgrown primitive beliefs that are based 


largely on fears. 


. I believe the church is the greatest institution in our country for devel- 


oping patriotism. 


. Some churches are all right, but others are “all bunk.” 
. I do not think the church is essential to Christianity. 
. I like our church for it gives young people a chance to have some ‘fun 


and yet it is religious. 


. The church represents shallowness, hypocrisy, and prejudice. 
. I do not think one has to belong to the church to be religious. 
. I feel the church services give me inspiration and help me to live up to 


my best during the following week. 


. I feel I can worship God better out of doors than in the church and I get 


more inspiration there. 


. I believe interest in the church is more emotional than rational. 
. I feel that the church is rapidly coming to apply scientific methods to 


its thinking and its promotion of religion. 


. When I go to church I enjoy a fine ritual service with good music. 


. I think the church is a parasite on society. 
. I think the church is a place for religious instruction of young and old 
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. I believe that if young people are not interested in the church it is the 


fault of either their parents or the church leaders. 


. I believe the church is losing ground as education advances. 
. The church has not helped me to any satisfactory ideas of God or the - 


future. I have had to work out my own ideas. 


. I think one church is about as good as another but some camouflage | 


better than others. 


. I go to church occasionally but have no specific attitude toward it. i . 
. I believe orthodox religion is all right but radicals upset the influence of | 


the church. 


. I go to church because I find the sermon usually interesting. 
. I am interested in the church because of its work for moral and social 


reform in which I desire to share. 


. I believe the church would be all right if it kept close to the teachings off 


Jesus but it does not and so fails. 


. I feel the need for religion but do not find what I want in any one 


church. 


and is essential in every community. 


. I think the church is after money all the time and I am tired of hearing 


of it. 


. I think the church and organized religion is necessary for the supersti- 


tious and uneducated but it should become less and less important. 


. I am careless about religion and church relationships but I would not 


like to see my attitude become general. 


. I like the opportunity in the young people’s society for discussion and 


self-expression. 


. I think the church is valuable for creating ideals and for setting a person ) 


right morally. 


. I think the organized church is an enemy of science and truth. 
. [like to go to church for I get something worth while to think about and || 


it keeps my mind filled with right thoughts. 


. Lenjoy my church because there is a spirit of friendliness there. 
. I believe the church is the greatest influence for good government and | 


right living. 


. The church is to me primarily a place to commune with God. 
. I do not receive any benefit from attending church services but I think 


it helps some people. 


CONSTRUCTION OF AN ATTITUDE SCALE 27 


. I give my money to support the church but I keep out of it because 
there is so much petty jangling. 

. I believe the church leaders are afraid to stand up and say what is true 
and right. The church is weak. 

. [ enjoy a good church service but do not take much stock in the teach- 
ings. 

. If I were picking a man for a responsible job I would give the preference 
to a regular church-member. 

. The church does not interest me now but sometime I expect I shall find 
it worth while to join. 

. I am attracted to the church by its courageous attack on what is com- 
monly called impossible. 

. I find the social life of the church too slow and uninteresting and that is 
all I care about. 

. I believe the church has done and can do far more for society than any 
organization of science. 


36. My belief is that the church is more spiritual and a greater force for 


good than it was a hundred years ago. It is increasing in value. 

. I think the church is hundreds of years behind the times and cannot 
make a dent of modern life. 

. I like church occasionally but do not feel that one should get too ardent 
about worship or church-going. 


39. I believe the church has grown up with the primary purpose of perpet- 


uating the spirit and teachings of Jesus and deserves loyal support. 


yo. I like the ceremonies of my church but do not miss them much when I 


stay away. 

. I regard the church as the institution for the development of spiritual 
life individually and socially. 

. I believe the church is far removed from the essentials of Christian 
love and brotherly kindness. 

. I believe church-membership is almost essential to living life at its 
best. 

. I believe the church is as necessary as the school for our social life. 

. I do not believe in any brand of religion or in any particular church but 
I have never given the subject serious thought. 

. I regard the church as a static, crystallized institution, and as such it is 
unwholesome and detrimental to society and the individual. 

. I think the church is learning more and more how to correlate science 
and religion for the good of humanity. 
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MEASUREMENT OF ATTITUDES 


No one attempts to live up to the ideals of the church but it serves as a | 
good stimulator. 

To me the church is more or less boring. 
I believe the church is a powerful agency for promoting both individual | 
and social righteousness. 
I believe the church is the greatest institution in America today. 

I have no desire to attend, join, or have anything to do with any chur 
I know. 

I find the services of the church both restful and inspiring. } 
I find more satisfaction in doing church work than in anything else I do, 

I think the church is more controlled by magic than by reason. 
I believe the average of the morals of church-members is considerably | 
higher than the average of non-church-members in the same socia 
status. 

The church is needed to develop religion which has always been con- 
cerned with man’s deepest feelings and greatest values. 
I believe the church is full of hypocrites and have no use for it. 
I never want to miss church for I always get an inspiration from a good 
church service. : 
I think the church keeps business and politics up to a higher standard _ 
than they would otherwise tend to maintain. 

I think the average church has a deadening influence and prevents t 
religion. 

I believe in the ideals of the church but I am tired of denominatio 
alism. 

I feel the church perpetuates the values which man puts highest in his | 
philosophy of life. 

I believe the church is fundamentally sound but some of its adheren 
have given it a bad name. 
I cannot think through the mysteries of religion but like to get the as 
surances of reality, of God, and immortality that the church gives anc 
stands for. 
I believe the majority of church-members are shameless hypocrites 
They do not practice what they pretend to do and do not care. 
I believe the church is working steadily for the application of the prin- 
ciples of Jesus to all personal-social relationships. 
I believe the church is an excellent character-building institution fo 
children. 

I think the church is a hindrance to true religion for it still depends upo 
magic, superstition, and myth. 
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20. I think the church is a divine institution and deserves the highest re- 
spect and loyalty. 

21. I believe churches are as essential to religion as schools are to education. 

22. I think the church is cursed by a narrow-minded, selfish lot of people. 

23. I think the church is necessary but it puts its emphasis on the wrong 
things. 

24. I support the church because I think it is the most unselfish and idealis- 
tic institution in society. 

25. I respect any church-member’s beliefs but I think it is all “bunk.” 

26. I believe the church develops friendships and ideals that help one to 
reject low and evil purposes and acts. 

27. I think the church seeks to impose a lot of worn-out dogmas and medi- 

eval superstitions. 

28. My experience is that the church is hopelessly out of date. 

29. I believe the church is doing a good work but will have to work on a 

seven-day-a-week program if it is going to keep up with the job. 

30. I believe the church is a changing human institution but it has divine 
realities behind it. The spirit of God moves through it. 


_ It will of course be noticed that some of these statements are 
mbiguous and that others are unsuitable for the present scale 
»ecause their acceptance or rejection does not indicate whether 
he indorser is really in favor of the church or against it. In fact, 
oany of the statements in this list violate the several criteria that 
ve have mentioned, but there was a definite plan in leaving these 
lefective statements in the list. Since there was available a cri- 
erion of ambiguity and a criterion of irrelevance, it was thought 
vest to retain defective statements in the experimental list so as 
o see whether these undesirable statements would be eliminated 
vy the objective criteria. It is undoubtedly desirable so to devise 
he technique of attitude scale construction that a minimum is 
eft for the personal judgment of the investigator as regards the 
value of statements of opinion for the scale. It will later be seen 
‘hat on the whole the most defective statements are fairly well 
2liminated by the objective criteria. 
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THE’ SORTING PROCEDURE 


In the present study the subjects were asked to sort the 130. 
statements into eleven piles to represent an evenly graduated se- | 
ries of attitudes from those extremely against the church to those 
which are very much in favor of the church. It should be noted | 
that in sorting the statements the subject did not express his own opin- | 
ions about the church. He was not asked to state what he believed | 
about any religious issue. He was asked merely to sort the state- | 
ments into the eleven piles, and we think that this sorting will be | 
done similarly by those who favor the church and by those who | 
aré antagonistic to the church. 

The 130 statements were mimeographed on small slips, one — 
statement on each slip. A set of these 130 slips was given to each - 
subject. He was also given eleven master-slips of the same size 
lettered from A to K. Only three of these slips were labeled as to 
the kind of opinions that should be placed on them, namely A, 
which contained the statement, ‘“‘This pile expresses highest ap- 
preciation of the church”; K, which contained the statement, 
“This pile expresses strongest depreciation of the church,” and 
the slip F, which contained the statement, “This pile contains © 
only neutral expressions.” 

_ It is a fundamentally important matter that the eleven piles 
should not be described except to give a starting-point such as 
neutrality and the two ends. If the eleven piles were defined by 
descriptive phrases such as is customary on rating scales of vari- 
ous kinds, the fundamental characteristic of the present measure- 
ment method would be destroyed. The reason for this is that the’ 
intervals between successive piles should be apparently equal 
shifts of opinion as judged by the subject. If they were labeled by 
descriptive phrases such as the steps in a graphic rating scale, the 
intervals would be defined by the descriptive phrases and there 
would be no guaranty that the successive intervals appear equal 
to the subjects. The intervals, if described by the investigator, 
would be arbitrary and set by him. It is essential that the subject 
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ye given the freedom to adjust the slips in the piles so that the 


‘intervals in attitude from one pile to the next seem to him to be 
{isan That is the unit of measurement for the present scale. 


The detailed instructions given to the subject were as follows: 


DIRECTIONS FOR SORTING SLIPS 


. The 130 slips contain statements regarding the value of the church. 


These have been made by various persons, students, and others. 


2. Asa first step in the making of a scale that may be used in a test of opin- 


ions relating to the church and religion we want a number of persons to 
sort these 130 slips into eleven piles. 


3. You are given eleven slips with letters on them, A, B, C, D, E, F, G, H, 


I,J, K. Please arrange these before you in regular order. On slip A put 
those statements which you believe express the highest appreciation of 
the value of the church. On slip F put those expressing a neutral posi- 
tion. On slip K put those slips which express the strongest depreciation of 
the church. On the rest of the slips arrange statements in accordance 
with the degree of appreciation or depreciation expressed in them. 


. This means that when you are through sorting you will have eleven piles 


arranged in order of value-estimate from A, the highest, to K, the lowest. 


. Do not try to get the same number in 1 each pile. They are not evenly 


distributed. 


. The numbers on the slips are code numbers and have nothing to do with 


the arrangement in piles. 


. You will find it easier to sort them if you look over a number of the slips, 


chosen at random, before you begin to sort. 


. It will probably take you about forty-five minutes to sort them. 
. When you are through sorting, please clip the piles together, each with 


its letter slip on top. Replace the eleven sets, clipped carefully, in the 
big envelope and return to E. J. Chave, Room 306, Swift Hall, University 
of Chicago. 


. Put your name and university classification on slip inclosed. 


Each subject was asked to indicate by number the two state- 


ments in each of the eleven piles which seemed to him to be most 
representative of that pile. This was intended to facilitate the 
selection of the statements to be used in the final scale but it is 
doubtful whether this procedure will be retained in this form in 
future scale construction. 
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The returns were tabulated so as to show for each subject the, 
pile in which he placed every one of the 130 statements. From) 
such a tabulation the data were assembled into Table I, which is al 
summary of the sorting of the 130 statements by 300 subjects, 
The first column of the table gives the code number of the state= 
ments by which they may be easily identified. The next two cok 
umns contain the scale-value and the Q-value, which is a measure 
of the ambiguity of each statement. These two measurements will 
be explained in a later paragraph. The remaining columns give 
the accumulative frequencies for each statement. The interpreta 
tion of this part of the table for statement No. 1 as an example : 


as follows. None of the 300 subjects placed statement No. 1 i 

any of the first five piles. This is indicated by the entries of 0.0 

in each of the first five columns. In this group 8 per cent placed 
this statement in pile F; 17 per cent placed it in F or G; 23 per 
cent placed it in F, G, or H; 33 per cent placed it in pile J or to the 
left of that pile; 52 per cent placed it in pile J or to the left of that 
pile, while all of them placed this statement in pile K or some- 
where to the left of K. { 


o 
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THE CONSISTENCY OF THE INDIVIDUAL SUBJECT b 


In an experiment of this sort in which large numbers of sub- 
jects participate, and in which the experimenter does not have the 
opportunity to observe each subject at work, one must expect that 
some subjects will do their task in a perfunctory or careless man- 
ner. It is also possible that some subjects fail to understand the 
experiment or fail to read the mimeographed instructions care- 
fully enough to understand just what is wanted. It has seemed de- 
sirable, therefore, to set up some criterion by which we could 
identify those individual records which were so inconsistent that 
they should be eliminated from our tabulations. The labor of tab- 
ulating the data is considerable, and we are justified in eliminating 
those individual subjects who have not responded with sufficient 
care or interest. 


SUMMARY OF SORTING OF 130 STATEMENTS BY 300 PERSONS 
TABLE I 
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It is also an important consideration to avoid any criterion of 
inconsistency for the elimination of careless or indifferent subjects 
vhich may constitute in effect an artificial loading of the main re- 
vults of the investigation. As a criterion for eliminating individual 
subjects we adopted the rule that any subject who placed 30 or 
nore of the 130 statements in one of the eleven piles was excluded. 
his objective criterion eliminated a number of subjects who were 
snown to do the sorting of the statements carelessly and still 
others who showed in conversation that they had evidently failed 
‘o understand the instructions. We do not believe that this is in 
ny sense an infallible criterion but it has undoubtedly served to 
liminate many of the subjects whose sortings were careless or who 
misunderstood the instructions. In the entire group of 341 sub- 
ects who participated in the original sorting of the 130 statements 
|r were eliminated from our final tabulations by this criterion. 
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CHAPTER III 
THE SCALE-VALUES 
GRAPHICAL DETERMINATION OF THE SCALE-VALUES 


The scale-values were determined graphically. In order to ik 
lustrate this procedure seven of the graphs are here reproduced, | 
and they show several different types of statement of opinion. In- 
Figure 2 statement No. 39 is represented. This graph is plotted | 
directly from the accumulative proportions of Table I. The erp 
shows immediately that practically all of the subjects classified | 
this statement in the five class-intervals most favorable to the 
church. The statement reads as follows: “I believe the church , 
absolutely needed to overcome the tendency to individualism and) 
selfishness. It practices the golden rule fairly well.” The curve of 
Figure 2 crosses the so per cent level at the interpolated scale-_ 
value of 1.8 which is assigned as the scale-value for this stuternciil 
The scaie-value is such that half of the readers classified this state. 
ment as more favorable to the church than the position 1.8, while 
half of them placed the statement as less favorable to the church | 
than this position in the series of eleven piles. | 

The scale-value is indicated by a small vertical arrowhead. On 
either side of the arrowhead is a small vertical line. These tw 
vertical lines indicate the two quartile points for the curve. I 
Figure 2 the two vertical marks are located at scale-values of 1. 
and 2.6, respectively. The separation between these two marks i 
a measure of the ambiguity of the statement. In the present cas 
the ambiguity, the Q-value, is 1.3, which is simply the differenc 
between 2.6 and 1.3. If a statement is very ambiguous, the dif 
ferent readers will place it over a wide range on the scale and th 
Q-value will be correspondingly high. If the statement is inter 
preted with regard to the specified attitude variable rather con 
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istently, if the statement is concise and uniform in the meaning 
yhich it conveys to all the readers, then they will place it at ap- 
vroximately the same position on the scale, and the Q-value will 
hen be correspondingly small. 

In Figure 3 a similar graph is drawn for statement No. 51, 
hich reads: “I feel I can worship God better out of doors than in 
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e church and I get more inspiration there.’’ This statement is 
llearly toward the other end of the scale and its scale-value is 6.9. 
rhe ambiguity, or Q-value, is 1.7. 

| Figure 4 has been included to show the psychometric graph for 
ttatement No. 9, which is judged rather uniformly. It has a low 
mbiguity. Its Q-value is only 0.7 with a scale value of 5.3. Itisa 
‘eutral statement which is judged to be neutral by the great ma- 
ority of the readers. The statement is, “I don’t believe church- 
joing will do anyone any harm.” In contrast with this statement 
s No. 8 which is a very ambiguous one. It reads: “TI believe the 
hurch has a good influence on the lower and uneducated classes 
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_ but has no value for the upper, educated classes.” This statement 
_is represented in Figure 5, according to which the scale value is 
6.7 and the ambiguity or Q-value is 3.6. Note that the statement 
spreads in a more or less rectangular distribution over eight class- 
intervals. This is a double-barreled statement, and it has been 
found that such statements turn out more frequently than not to 
be ambiguous. Such a statement is eliminated from the final scale 
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on account of the objective measure of ambiguity which is given 
directly in the Q-value. 

Figure 6 represents statement No. 28 and is included to show 
the appearance of the psychometric graph when it is continuous 
but skewed. 

In Figure 7 we have a psychometric graph for statement No. 
113 which more than half of the readers placed in the first of the 
eleven piles. Its scale-value can be obtained by extrapolation as 
| shown in the graph whereby the scale-value is located slightly be- 
| low the value of 1.00. In order to estimate the Q-value, the upper 
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quartile distance is doubled since the lower: quartile is indetermi- 


nate. The lower quartile point might be determined by additional 


———— 


Accumulative proportions 


extrapolation but that is probably less desirable than to double 
the upper quartile distance as an estimated Q-value. 
In Figure 8 we have the graph for statement No. 48. It is 


_ clearly judged to be at the anti-end of the scale. Its scale value 


can be determined by extrapolation. The curve is continued until 
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it crosses the 50 per cent level, which is at approximately 10.4, and 


| this is assigned as the scale-value of the statement. The Q-value 


is ascertained by doubling the difference between the median 
point and the lower quartile point. It should be noted that the en- 
try of 1.00 in column K for statement 48 in Table I is ignored in 
drawing the curve of Figure 8. The entry in column K is always 
unity, and the ordinate at the point 11 is necessarily unity because 
all judgments which would place a statement beyond the point 11 
are concentrated at the point 11. It does not represent the true 
ordinate at that point. 


42 MEASUREMENT OF ATTITUDES 


RELIABILITY OF THE SCALE-VALUES 


An approximate estimate of the reliability of the scale-values 
may be obtained in the following manner: The Q-value is twice 
the quartile deviation of the distribution of each opinion on the © 
subjective scale. 
Hence 


Q=2q. 


The average Q-value of the forty-five opinions in the experi- 
mental scale is 1.67 and consequently 


Q 


=~=0.84. 
q= "= 0.84 


The standard deviation of the distribution of scale-values is 
therefore, on the average, 


odist = —2- = 1.25 scale units . 
0.67 


The scale-value of an opinion is the median of its distribution 
on the subjective scale. Hence, the standard error of the scale 
value is 


o 
Omed= 1.25 —= 


Vn 


=0.09 when m= 300. 


The probable error of the scale value is consequently 


p.€.ma= 0.67 X0.09 =0.06 scale-units . 


This is a very satisfactory reliability for the scale-values which 
are recorded to one decimal in our tables. 

In order further to test the stability of the scale-values in a 
practical way we ascertained the changes in scale-values brought 
about by increasing the number of subjects from 150 to 300. In 
order to make such a test, we tabulated the results for the first 150 
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ubjects who sorted the 130 statements into eleven piles, subjec- 
ively equally spaced. The sorting was continued until 300 sub- 
ects had done it. The scale-values were then determined for the 
ntire group of 300. The discrepancies between the first set of 


TABLE II 


FREQUENCY TABLE OF DIFFERENCES d =|S;—S2| BETWEEN THE 
ScALE-VALUES S, WHICH WERE DETERMINED FROM 150 
SUBJECTS AND THE SCALE-VALUES S, WHICH WERE DE- 
TERMINED FROM THE ENTIRE GROUP OF 300 SUBJECTS 


d J 
—0.4 ° 
—0.3 2 
=—0.2 6 
—o.1 25 

0.0 64 Mean discrepancy for the whole 
anOnan 19 list of 130 statements = .074 
+o.2 Io 
Ours 2 
+0.4 

130 


TABLE III 
FREQUENCY TABLE OF DiFFERENCES d=|S;—S,| BETWEEN THE 
' ScatE-VaLuEs S; WHICH WERE DETERMINED FROM 150 
SUBJECTS AND THE SCALE-VALUES S,; WHICH WERE DE- 
TERMINED FROM 300 SUBJECTS 


d 
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Mean discrepancy for the 45 state- 
ments in the experimental scale 
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scale-values, determined by 150 subjects, and the final set of scale- 
values, determined by the entire group of 300 subjects, are sum- 
marized in Table II. The same kind of summary is shown in 
Table III for the discrepancies in the scale-values of the 45 state: 
ments chosen for the experimental scale. It is seen that the mean 
discrepancy between the scale-values from the data for 150 sub- 
jects and the scale-values from the 300 subjects is 0.074 scale-units 
for the entire set of 130 statements and 0.038 for the 45 statements 
in the experimental scale. These discrepancies are very small and 
they indicate that 300 subjects are quite sufficient to stabilize the 
scale-values for the method of equal-appearing intervals that we 
have used. 


AN OBJECTIVE CRITERION OF AMBIGUITY 


Inspection of the curves in Figures 2 to 8 inclusive reveals that 
some of the statements are more ambiguous than others. The de- 
gree of ambiguity in a statement is immediately apparent, and in 
fact it can be definitely measured. The steeper the curve, the 
smaller is the range of the scale over which it was classified by 
the readers and the clearer and more precise is the statement. The 
more gentle the slope of the curve, the more ambiguous is the 
statement. A simple method of measuring ambiguity is to deter- 
mine the scale-distance between the scale-value at which the curve 
of proportions has an ordinate of 0.25 and the scale-value at which 
the same curve has an ordinate of 0.75. This is merely the quartile 
distance. 

The ambiguity, or Q-value, constitutes one of the objective 
criteria for eliminating unsuitable statements. Other things being 
equal, a statement with high Q-value should be eliminated from 
the scale. It has not been possible to select the statements for the 
final scale so as to satisfy completely all of the criteria simultane- 
ously but the selection was made with the several criteria listed 
for each statement. 

Since the Q-value is to be used for eliminating ambiguous 
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statements it becomes a matter of some importance to know if the 
average Q-value changes for different parts of the scale. In order 


to make this relation apparent we have plotted the average Q- 


value against scale-values in Figure 9. This diagram simply 
“means that all the statements with scale-values o—1 have an 
average Q-value of 1.75, and similarly for the other points in the 
diagram. If all the statements throughout the whole range were 


oO 
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of the same average ambiguity, the line of this diagram would be 
horizontal and that would be the ideal condition for our present 
purposes. It does not show any gross variation in ambiguity al- 
though the statements which are in the vicinity of 7 or 8 on the 
scale have noticeably higher ambiguity than the other statements. 


AN OBJECTIVE CRITERION OF IRRELEVANCE 


We have tried to devise objective checks on our procedures 
wherever possible, and in the present experiments we have even 
retained intentionally a number of statements of opinion which 
were clearly ambiguous or otherwise unsuitable for an attitude 
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scale in order to see to what extent they could be eliminated by | 
objective methods. We should hardly expect to be able to con- / 
struct a workable attitude scale entirely by the mechanical ap- 
plication of objective rules. Some latitude will probably always be 
given to the judgment of the investigator, but our methods will be | 
successful to the extent that the individual judgments of an in- = 
vestigator about material of this sort can be checked objectively. 
In the present study we retained some material which would have 
been eliminated by inspection at the very start just in order to — 
test the validity of the several objective criteria. 

The criterion of ambiguity is concerned with the spread of a 
statement over the subjective scale of equal-appearing intervals. 
If the 300 subjects place a statement of opinion in widely different — 
intervals on the subjective scale, the Q-value of the statement will 
be large and the statement will therefore be judged by this ob- 
jective criterion to be ambiguous. It has widely different mean- 
ings along the attitude scale when it is read by different subjects. 
Clearly such statements should be eliminated. Often it is possible 
to tell by inspection that a statement will have a large Q-value. It 
should be noted that the Q-value of a statement of opinion does © 
not reflect the actual opinions held by the subjects on the issue in ~ 
question. They sort the statements merely in accordance with the 
attitude that they read into the statements without thereby ex- — 
pressing their own attitudes. { 

The criterion of irrelevance, on the other hand, is concerned — 
with the records of actual votes. The whole list of 130 statements 
was mimeographed and presented to 300 subjects with the request — 
that they check the statements that they indorsed or agreed with © 
and that they leave blank the statements which they did not care ~ 
to indorse. It was then possible to study the returns for internal — 
consistency. If we find considerable inconsistency, we might at- 
tribute it to the carelessness of the subjects in making their check — 
marks more or less at random, or we might attribute it to defects 
in the statements themselves. In the present experiments we 
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| 

ound a certain amount of inconsistency throughout the whole 
ist, and it can undoubtedly be attributed at least in part to the 
ubjects themselves. But the inconsistencies vary with the state- 
nent that is chosen as a basis of comparison with all the rest, and 
uch differences are due primarily no doubt to defects in the state- 
nents themselves. We have so regarded them and we have de- 
ised a criterion of irrelevance which can be used further to elim- 
nate the unsuitable statements from the scale. 

This criterion is constructed as follows: Suppose that a state- 

aent of low ambiguity is properly scaled at the point 6. If a sub- 
ect has an attitude which is also scaled properly at the point 6, 
hen we should expect him to check that statement. Another sub- 
ect who is scaled at the point 12 should be less likely to check that 
tatement, and similarly there should be a low probability that a 
ubject at the point zero will check the statement at 6 on the 
cale. 
In order to make this type of analysis quantitative we have 
evised a rather crude index of similarity which is based on the 
oting of any large group of subjects. The index of similarity for 
ny pair of statements is based on three facts, namely, m,=the 
otal number of subjects who indorse statement a in the compari- 
on; n= the total number of subjects who indorse statement 6 in 
he comparison; ”;=the total number of subjects who indorse 
oth a and 8. 

If the two statements a and 0 are practically identical in the 
ttitudes they reflect, then we should expect to find that those 
ubjects who indorse statement a will also indorse statement 0. 
‘his factor, 7a, will therefore be in the numerator of the index 
f similarity. On the other hand, the statements vary consider- 
bly in intrinsic popularity even when they are scaled at identical 
oints on the scale. The more popular a statement is, the larger 
ill be the number of people who indorse it and any other state- 
vent. In order to reduce the index of similarity to the same basis 
f popularity for all statements, the number of subjects who in- 


48 MEASUREMENT OF ATTITUDES 


dorse both statements is divided by the product of the numbe}| 
of total indorsements for each of the two statements so that the 
index of similarity becomes | 


Nab 
Na? Nb 


If we tabulate the indices for statement a with each of all the 
other statements in turn, we shall have the common factor 1/m% 
which may be disregarded since it is a constant. We shall then! 
have 

Index of similarity’ for statement a=Co=™ : 

This index is written for the comparison of statement a with each 
of the others. It is evident that the maximum possible value for 
this index is unity and its minimum value is zero. If all of the peo- 
ple who indorse statement a also indorse statement k, then the in- 
dex of similarity is unity as it should be because the two state- 
ments are then evidently very similar in the attitudes reflected. 
If, on the other hand, none of those who indorse statement a also 
indorse statement k, then the index is zero and this is reasonable 
because the two statements are then evidently very different in 
the attitudes which they describe. 

In Figure 10 we have a graphical representation of the indices 
of similarity for statement 96 with each of the other statements, 
plotted against the scale-value of each statement. The scale-value 
of statement 96 is indicated by the small arrow on the top line of 
the diagram. Its index of similarity with itself under ideal condi- 
tions would be unity. It is immediately apparent that the indices 
for statement 96 and each of the other statements are very low for 
those statements which are distant from statement 96. This is to 
be expected. In other words, those who indorsed statement 96, 

Since the completion of this monograph the index of similarity has been de- 


veloped in a better and more correct form. Its complete description will be pub- 
lished shortly. 
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which is scaled at 10.5, do not often indorse statements which are 
scaled in the four or five class-intervals at the other end of the 
scale. The indices are higher when the second statement ap- 
proaches the scale-value of statement 96. Every small circle in 
this diagram represents the index of similarity between statement 
96 and a second statement, and it is placed immediately above the 
scale-value of that second statement. 


29s oe nr rr ar Wisi iE 
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The criterion of irrelevance is the appearance of the whole dia- 
gram. If the indices of similarity are relatively high near the scale- 
alue of the first or common statement and relatively low for 
statements that are distant from the first or common statement, 
hen the first statement is considered to be satisfactory. It means 
merely that the people who indorse statement 96 are not so likely 
to indorse statements that are scaled distant from the scale-value 
pf 96. The appearance of Figure 10 is considered to be satisfactory 
, nd therefore statement 96 js retained: 

We may turn next to'a similar Binighcte dor a statement that 
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was discarded by the criterion of irrelevance. Figure 11 shows thi 
indices of similarity for statement 23. The scale-value of this state| 
ment is also indicated by a small arrow on the top line of the dial 
gram. Consider the small circle to the extreme left of this diagram 
It is the index of similarity between statement 23 and statemen| 
101, which has a scale-value of 0.02. The index is 0.56. The othe} 
circles are located in a similar manner and represent the degree 0 


Index of sfralarity 
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similarity between statement 23 and each of the other statements. 

Note that the people who indorse statement 23 are just as 
likely to indorse statements at either extreme of the scale as the 
statements that are scaled near to statement 23. The points scat- 
ter more or less horizontally on the diagram. This indicates clear- 
ly that there is something fundamentally wrong with statement 23 
as an index of a particular attitude on the scale. In other words, 
if a man indorses this statement we can say nothing about his atti- 
tude toward the church. because. he.is tikely to indorse not only 
statements in the class-interval 4-5 but also at either or both ex- 
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_ tremes of the scale as far as one can judge by statement 23. The 
‘indorsement of this statement therefore does not help us in al- 
_ locating the subject to a point on the scale. 

. We then turn back to the original statement and we find that 
| it reads as follows: ‘I am interested in a church that is beautiful 
|. and that emphasizes the aesthetic side of life.” We can now see 
_ why this statement is irrelevant to the attitude variable that we 
are attempting to measure. The pious church-member can cer- 
| tainly indorse this statement conscientiously. Of course he is in- 
terested in a church that is beautiful. But the most outspoken 
atheist can also indorse the statement because he may very well 
be interested in beautiful buildings, including beautiful churches, 
| and he may very well also be interested in church music even 
| though he does not take at all seriously the religious functions of 
| the church. The attitude reflected by the indorsement of state- 
' ment 2 3 is therefore not valid as an index of the attitude variable 
_ which is implied in the list of statements as a whole. The fact that 
| the indices of Figure 11 spread more or less horizontally across the 
| whole scale constitutes the objective reason for discarding state- 
| ment 23. 

We may now review more briefly a few additional specimens 
showing the criterion of irrelevance for other statements. In Fig- 
| ure 12 the indices of similarity have been plotted for statement 7. 
| This statement is scaled at 8.2 and the indices fall to very low 
values at the other end of the scale. This statement is therefore 
retained in the final scale. 

Figure 13 shows a similar plot for statement 113 in which the 
indices of similarity fall to rather low values for second statements 
in the upper half of the scale. The indices are all above 0.90 for 
the first few class-intervals. The statement is therefore retained 
for the final scale. 

Figure 14 contains a similar plot for statement 49. Here again 
| the indices spread more or less horizontally across the whole scale 
and therefore statement 49 is discarded. We turn to the original 
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statement. It reads as follows: “TI do not think one has to belong 
be the church to be religious.” It is quite possible for a pious 
church-member to indorse this statement. It also is possible for 
the non-religious person to indorse it as a statement of fact even 
Monch he may have no interest in either the church or in religion. 
Fe is to be expected that the proportion of indorsements of this 


Lndex Of siularily 
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statement should be higher at the anti-end of the scale and this is 
hat we find in Figure 14, but the discrimination is by no means 
sufficient. The indices have roughly the same level clear across 
the scale and the statement is therefore discarded. 

Figure 15 shows a satisfactory discrimination for statement 50 
Decause the indices are above 0.90 in che vicinity of the scale-value 
of statement 50, indicated by the small arrow, and they fall to 
rather low values at the other end of the scale. The statement is 
therefore retained. 

Figure 16 shows the plot for statement 9, which is discarded 
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because the indices of similarity do not show sufficient variation 


| for the different parts of the scale. The statement actually reads: 
| “I don’t believe church-going will do anyone any harm.” Here 
| again we can readily imagine that the pious church-member will 


acknowledge the truth of the statement. The strong antichurch 
voter may also be willing to acknowledge that church-going will 


_ not do anyone any harm. The latter group do not so readily in- 
_ dorse the statement as the former, but inspection of the diagram 
indicates clearly that the discrimination is unsatisfactory. People 

all over the scale indorse this statement although they may have 


quite different feelings or ideas in doing so. The mere indorse- 


ment of this statement does not help us in locating the voter on 


the scale. The statement is therefore judged to be irrelevant to 
the scale, which is represented by the whole list of statements. 
It would undoubtedly be possible to quantify the criterion of 


irrelevance still further. It seems better to delay further quantifi- 


cation until a more generalized rational formulation has been com- 
pleted. 

We have brought to bear on the selection and allocation of the 
statements of opinion two objective criteria, namely the criterion 
of ambiguity, the Q-value, which is based on the degree of uni- 
formity in the sorting of the statements, and the criterion of ir- 
relevafice, which is based on the consistency of the actual voting, 
or indorsing. These two parts of our experiments were carried out 
on two different groups of subjects. 

We have found that a statement may be sorted quite uni- 


formly by all the subjects and still be declared unsuitable by the 


criterion of irrelevance. This may be explained as follows: When 
we read a statement and then judge the attitude which it wouid 
ordinarily represent, we may agree fairly well and thereby assign 
a low Q-value to the statement. When we are asked to indorse the 
statement, we may find that people of widely different attitudes 
find widely different reasons for indorsing it. This is especially 


likely to happen when a statement can be read either as an ex- 
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pression of attitude or as an expression of fact. For example, the 
churchman is not likely to volunteer the statement, ‘“Church- 


going will not do anyone any harm.”’ A person who volunteers — 


that statement spontaneously is not likely to be a devoted church- 
man. The situation is quite different when the statement is made 

by someone else and presented for indorsement as to whether it is - 
true or false. In such a situation the churchman may acknowledge 
the statement to be true even though he would not naturally so 
express his own attitudes. This distinction between that which 
we say spontaneously in expressing our attitudes and that which 
we are willing to acknowledge or indorse when stated by someone 
else probably accounts for the fact that the criterion of ambiguity 


and the criterion of irrelevance do not always eliminate the same 


statements. 
Ideally, the scale should perhaps be constructed by means of 


the voting only. It may be possible to formulate the problem so — 
that the scale values of the statements may be extracted from the — 


records of actual voting. If that should be possible, then the pres- 
ent procedure of establishing the scale-values by sorting will be 
superseded. 


INFORMAL CRITERIA FOR THE SELECTION OF OPINIONS 


As a result of our work on the present attitude scale we have 
formulated a list of informal criteria which will be used in the con- 
struction of future attitude scales. By these criteria it is seen that 
many of the opinions in the present experimental scale are defec- 
tive, and it is our plan to start the construction of an improved 
attitude scale which shall be free as far as possible from the de- 
fects that we can now describe, but these criteria were not clearly 
formulated when the original material for the present experiments 
was compiled. 

The following is a list of some informal criteria for the selection 
of opinions in the construction of an attitude scale. The list is cer- 


- 
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tainly not complete and it may very well be decided that some of 
the following characteristics are not defects. 

1. As far as possible, the opinions should reflect the present 
attitude of the subject rather than his attitudes in the past. By 
wording the opinions in the present tense one avoids the situation 
in which a subject might indorse two conflicting opinions, one re- 
ferring to his past attitude and one to his present attitude. The 
scale-value of the subject should naturally describe his present at- 
titude. 

2. It has been found that double-barreled statements tend to 
be ambiguous. The material should be edited so that each opinion 
expresses as far as possible only one thought or idea. The subject 
is confused in reading a double statement in which he might want 
to indorse one idea but not the other. Example: “I believe in the 
ideals of the church but I am tired of denominationalism.’’ Per- 
_ haps this statement would serve better if it were divided into two 
opinions. 

3. One should avoid statements which are evidently appli- 
cable to a very restricted range of indorsers. Example: ‘‘I go to 
church because I enjoy good music. I am in the choir and get 
musical training and chorus-singing.”” The first sentence can be 
indorsed by a fairly wide group of indorsers, but the second state- 
ment can be indorsed only by those who happen to be members of 
a church choir. It is probably not worth while to include opinions 
which are so restricted by factual qualifications in an attitude 
scale. What we want to measure is attitude and in doing so we 
should avoid so marked an influence on the range of possible in- 
dorsers. The foregoing statement would probably be much im- 
proved for our purposes if only the first sentence were retained for 
scaling. 

4. Each opinion selected for the attitude scale should pref- 
erably be such that it is not possible for subjects from both ends 
of the scale to indorse it. Such opinions will be canceled by the 
objective criteria, but when this defect is conspicuous the state- 
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ment might as well be discarded at the start. On the other hand, 
there will probably always be a certain number of opinions in a 
list which have this defect and which are not recognized when read — 
by the investigator. Later, when they are discarded by the ob- 
jective criteria it is usually easy to see why it is that these state- 
ments are eliminated. In other words, it is easier to have the ob- 
jective basis for discarding a statement and then to see why it 
should have been discarded by inspection than to spot these de- 
fective statements in the reading of the original whole list of state- 
ments. 

5. As far as possible the statements should be free from re- 
lated and confusing concepts. In the present material we have a — 
number of statements which mention “true religion” and “the — 
religion of Jesus.” These statements are likely to be difficult to 
interpret because, in addition to the assertions about the church, 
these statements involve also additional though related concepts 
which might as well be avoided wherever possible. Example: “I 
think the church allows denominational differences to appear larg- 
er than true religion.” A statement of this type can just as well 
be written directly with reference to the alleged overemphasis — 
of denominational differences by the churches without involving Z 
the uncertainties of interpretation of the phrase, “true religion.” 

6. Other things being equal, slang may be avoided except — 
where it serves the purpose of describing an attitude more briefly — 
than it could otherwise be stated. For example, to say that most 
sermons are ‘‘all bunk” may be justified if it should be considered 
a natural way of expressing an attitude which is to be represented 
on the scale. 


CHAPTER IV 
THE EXPERIMENTAL ATTITUDE SCALE 


DESCRIPTION OF THE SCALE 


A final list of 45 statements of opinion was selected from the 
original list of 130 opinions. The selection was made with con- 
ideration of the criterion of ambiguity, the criterion of irrele- 
vance, the scale-values, and by inspection of the statements. The 
statements were so selected that they constitute a more or less 
aniformly graduated series of scale-values. The scale-values rep- 
‘esented by the 45 statements in the final list are shown in Figure 
17, the purpose of which is to show that the 45 statements repre- 


Distribution of scale values 1 
the list of forty-five goiriens 
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sent a more or less evenly graduated series of scale-values. The 
-wo upper horizontal lines constitute the scale proper and between 
-hese two lines there are small cross lines. Each of these cross lines 
‘epresents the location of one of the 45 opinions. There are forty- 
ive such cross lines. The class intervals on the scale and their 
iumerical designations are indicated immediately below. Inspec- 
‘jon of the figure shows that the graduation is by no means perfect 
yut it is probably as close as is necessary. Four opinions were se- 
ected from each of the eleven class-intervals of the scale. In ad- 
lition, one extreme statement that scaled at 11.8 or beyond was 
ncluded. 

The experimental scale as finally presented to the several hun- 
lred subjects for actual voting together with the accompanying 
nstructions is given here. The questions on the title page of the 
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blank were inserted for the possibility of correlating facts obtaine| 
from the replies with the scores on the attitude scale. For ou 
present purposes these items are of secondary importance a! 
though in the practical use of a scale of this kind these correli 
tional items probably would constitute an essential part of t 
investigation. As a by-product of our present investigation, 
have tabulated the various facts about the voters in order tha 
separate frequency distributions may be constructed for subject! 
of various classifications. 


EXPERIMENTAL STUDY OF ATTITUDE 
TOWARD THE CHURCH 


This is an experimental study of the distribution of attitude toward th 
church. You will be asked to read a list of statements about the church.ani 
to indorse those that express your own sentiment. Let your own experienc 
with churches determine your indorsements. 


1. Name* 


2. Group ee 
3. Underline your classification: 

Freshman, Sophomore, Junior, Senior, Graduate, Faculty, Unclassifie 
. Department of major work: 
. Do you attend church frequently? Yes No (Underline one) 
. Are you an active member of a church? Yes No (Underline one) 


Ir nun 


. Before turning this page write a brief statement indicating your generé 
attitude toward the church as you know it. 


8. Write an X somewhere on the line below to indicate where you think yo 
belong. 


Strongly favorable Neutral Strongly agains 
to the church the churc 


*You need not sign your name, if you prefer to give your opinions anon) 
mously. 
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Check (7/) every statement below that expresses your sentiment toward 
' thechurch. Interpret the statements in accordance with your own experience 
with churches.' 
(40) 1. I think the teaching of the church is altogether too superficial to 
have much social significance. 


iS) 


. I feel the church services give me inspiration and help me to live 
up to my best during the following week. 


(50) 


(t10) 3. I think the church keeps business and politics up to a higher 
standard than they would otherwise tend to maintain. 


(103) 4. I find the services of the church both restful and inspiring. 
(54) 5. WhenI goto church I enjoy a fine ritual service with good music. 
(28) 6. I believe in what the church teaches but with mental reserva- 
tions. 


(77) 7. I do not receive any benefit from attending church services but I 
think it helps some people. 
(13) 8. I believe in religion but I seldom go to church. 


(69) 9. Lam careless about religion and church relationships but I would 
not like to see my attitude become general. 


(96) 10. I regard the church as a static, crystallized institution and as 
such it is unwholesome and detrimental to society and the individ- 
ual. 

| (93) xx. I believe church membership is almost essential to living life at 

s its best. 

(21) 12. I do not understand the dogmas or creeds of the church but I 

find that the church helps me to be more honest and creditable. 
(7) 13. The paternal and benevolent attitude of the church is quite dis- 

tasteful to me. 

(19) 14. I feel that church attendance is a fair index of the nation’s mo- 
rality. 

(34) 15. Sometimes I feel that the church and religion are necessary and 
sometimes I doubt it. 

(114) 16. I believe the church is fundamentally sound but some of its ad- 

herents have given it a bad name. 
(65) 17. I think the church is a parasite on society. 


t The statements of this list are numbered consecutively as shown. The number 
in parentheses before each statement refers to the original list of 130 statements. 
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(64) 
(38) 
(rr) 
(87) 


(89) 


(113) 
(51) 


(128) 
(33) 


(95) 


(125) 
(74) 
(41) 


(101) 
(27) 


(75) 
(72) 
(56) 
(24) 
(119) 


(107) 


20. 


21. 


22. 
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. I feel the need for religion but do not find what I want in any one 


church. 


. I think too much money is being spent on the church for the 


benefit that is being derived. 

I believe in the church and its teachings because I have been ac- 
customed to them since I was a child. 

I think the church is hundreds of years behind the times and can- 
not make a dent on modern life. 

I believe the church has grown up with the primary purpose of 
perpetuating the spirit and teachings of Jesus and deserves loyal 
support. 


. I feel the church perpetuates the values which man puts highest 


in his philosophy of life. 


. I feel I can worship God better out of doors than in the church 


and I get more inspiration there. 


. My experience is that the church is hopelessly out of date. 
. I feel the church is petty, always quarreling over matters that 


have no interest or importance. 


. I do not believe in any brand of religion or in any particular 


church but I have never given the subject serious thought. 


. Irespect any church-member’s beliefs but I think it is all “bunk.” 
. I enjoy my church because there is a spirit of friendliness there. 
. I think the country would be better off if the churches were closed 


and the ministers set to some useful work. 


. I believe the church is the greatest institution in America today. 
. I believe in sincerity and goodness without any church ceremo- 


nies. 


. I believe the church is the greatest influence for good govern- 


ment and right living. 


. I think the organized church is an enemy of science and truth. 
. I believe the church is losing ground as education advances. 
. The churches may be doing good and useful work but they do not 


interest me. 


. I think the church is a hindrance to religion for it still depends 


upon magic, superstition, and myth. 


. The church is needed to develop religion, which has always been 


concerned with man’s deepest feelings and greatest values. 
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(36) 39. I believe the churches are too much divided by factions and de- 
nominations to be a strong force for righteousness. 


(48) 40. The church represents shallowness, hypocrisy, and prejudice. 


(127) 41. I think the church seeks to impose a lot of worn-out dogmas and 
medieval superstitions. 


(14) 42. I think the church allows denominational differences to appear 
larger than true religion. 
(90) 43. I like the ceremonies of my church but do not miss them much 
when I stay away. 
(100) 44. I believe the church is a powerful agency for promoting both in- 
dividual and social righteousness. 


(73) 45. I like to go to church for I get something worth while to think 
about and it keeps my mind filled with right thoughts. 


METHOD OF SCORING 


We have given numerical designations to the successive class- 
intervals of the scale. The unit of measurement is defined by the 
number of equal-appearing intervals into which the original list 
of 130 statements was sorted by the first group of subjects. Since 
the subjects were asked to sort out the 130 statements into eleven 
piles subjectively equally distant from each other, the unit of 
Measurement is thereby defined. The origin is arbitrarily as- 
signed. We could have placed the origin in the middle of the 
scale, but that would necessitate dealing with negative class-inter- 
vals and nothing is statistically gained thereby. We therefore as- 
signed the origin to one end of the scale, the extreme pro-end. In 
most mental tests the high and low scores represent performances 
that can be described as good or bad, but in the present instance 
there is, of course, no such possibility. We have no right to say 
that a person who is very much devoted to his church is in any 
sense better than a person who has no such affiliations. Nor can 
we say that one person scores “‘higher” than another except in the 
arbitrary sense that one end of the scale is called zero and the 
other end eleven. It is a matter of indifference which end is chosen 
for the high numerical scores. What we are here concerned with 
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is merely the description of one aspect of the attitudes of people 
about the church, an aspect which can be thought of as a linear 
continuum. We have no interest in any implications that one 
score is better than some other score in a moral sense or that one 
score is higher than some other score in the sense of relative value 
or achievement. These considerations, important for the unbiased 
construction of an attitude scale, of course leave any user of such 
a scale entirely free to make his own moral interpretations of the 
scores. 

It is to be expected that many of the users of an attitude scale 
will have as their motive the influencing of people toward a chosen 
end of the scale. Our object is to produce a tool, as objective as 
possible, by which to describe attitudes. In the absence of ob- 
jective tools for the description of social phenomena, the conclu- 
sions of any investigator are always subject to the challenge that 
he has reported his facts with his own bias, either intentionally or 
unintentionally. To the extent that social phenomena may be de- 
scribed with devices that are free from the investigator’s own bias, 
to that extent we shall be able to make sound inferences, to just 
that extent shall we be able to separate our facts from our own 
personal desires. 

Having adopted an origin of measurement which is assigned 
arbitrarily at one end of the series of available opinions, and hay- 
ing a unit of measurement, the equal-appearing interval as de- 
scribed, we can proceed to ascertain the mean scale-value of all 
the opinions that any individual subject indorses. This mean 
scale-value of all the opinions which a subject indorses we call his 
score. 

In the clerical work of scoring the blanks there are two alter- 
native procedures which will probably give substantially the same 
results. We may assign the scale-value to each of the statements 
that a subject has indorsed and then calculate their arithmetic 
mean. This is legitimate to the extent that each class-interval of 
the scale is equally represented by opinions. Since we have the 45 
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statements in the experimental scale graduated more or less 
evenly, we feel justified in allocating each subject to the scale at 
the mean scale-value of the opinions that he has indorsed. This 
seems reasonable because there is approximately the same number 
of opinions available for him to check in each class-interval. 

Another procedure which is statistically equivalent is to assign 
a rank order number to each of the 45 statements in the scale and 
merely to calculate the average rank order of the statements 
which he has indorsed. This procedure is equivalent to the previ- 
ous method in so far as we have the 45 opinions evenly spaced 
throughout the scale. In the blank the 45 statements were pre- 
sented in random order, not in the order of their scale-values. This 
was done in order to encourage the subject to read all of the state- 
ments. 

RELIABILITY OF THE SCORE 

In order to test the reliability of the experimental scale it was 
divided into two parts. The usual procedure of assigning alternate 
items to the two forms A and B was slightly modified because that 
procedure would give one of the two parallel forms a slightly 
higher mean scale-value than the other. In order to make the two 
forms truly parallel, as far as that was possible with the material 
at hand, we arranged all the opinions of the scale in rank order ac- 
cording to their scale-values. Successive pairs were then marked 
off. The first opinion in each pair had, of course, a slightly lower 
scale-value than the second. In the odd numbered pairs the first 
opinion with the lower scale-value was assigned to form A of the 
scale, and in the even numbered pairs the second opinion with the 
higher scale-value was assigned to form A of the test. The others 
were assigned to form B. In this manner we obtained two forms, 
A and B, each half as long as the experimental scale, and so pre- 
pared that the average scale-values of the two forms were prac- 
tically identical. The odd statement scaled at 11.8 was included 
in both forms, A and B. 

The blanks of two hundred Freshmen were used for the pur- 
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pose of determining reliability. Each blank was given two scores, 
one score for the opinions that had been assigned to form A and a 
second score from the same blank for the opinions that had been 
assigned to form B. The two sets of two hundred partial scores 
were then correlated. The correlation between the two sets of 
scores was 0.848. When this correlation between the two halves 
of the scale is interpreted by means of the Spearman-Brown for- 
mula, the estimated reliability of the whole scale is 0.92, which is 
quite satisfactory. Earlier in the study the same procedure was 
applied to the blanks of one hundred subjects in which the corre- 
lation between the two halves of the scale turned out to be 0.89, 
which is comparable with the correlation of 0.85 between the two 
halves of the scale for the larger group of two hundred subjects. 
If the correlation of 0.89 between the two halves for the one hun- 
dred subjects is interpreted by the Spearman-Brown formula, the 
reliability of the whole test is estimated to be 0.94. 


CHAPTER V 
APPLICATION OF THE EXPERIMENTAL SCALE 


SOME ACTUAL DISTRIBUTIONS OF ATTITUDE 


While the scale developed in these experiments cannot be re- 
garded as completely satisfactory, it is sufficiently diagnostic to 
make it worth trying on several groups for comparative purposes. 


TABLE IV 
DISTRIBUTION OF ATTITUDE IN SEVERAL GROUPS 
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* f =frequency, p =proportion. 


The scale was presented to students at the University of Chicago, 
both undergraduates and graduates, to some faculty members, 
and to the Chicago Forum. In Table IV the frequency distribu- 
tions of scores are summarized and in Figure 18 these frequency 
distributions are shown graphically for the groups larger than one 


hundred subjects. All of these distributions have been reduced to 
the same area by expressing each class-frequency as a proportion 


of the entire group. 


67 


68 MEASUREMENT OF ATTITUDES 


The mean score for each group is indicated by a small arrow 
on the base line. Inspection of these frequency polygons shows 
immediately the wide range of attitude toward the church rep- 


Freshrrer? 
N= 548 


o——_. 
Ye ai Ore nO eet 
——0 


Sophornores 
N=/27 


Serv/ors 


Graduate studeriwts 
N=2/0 


LQrvirity studerits 
N = /03 


Chicago Ferurr 
N=/8/ 


fa) ii 2 3 4 Ss S Zz a og Sasa 
The oftitude sca/e 


} APPLICATION 69 
resented in all these groups. As is to be expected, the divinity 
‘students concentrate more strongly in favor of the church than 
any of the other groups. The Chicago Forum has the highest 
: score, indicating that this group is, on the average, more frankly 
“antagonistic to the church than any of the student groups. The 
four undergraduate classes do not show any distinct trend to be- 
“come more in favor of or more against the church as they progress 
: through college. The graduate students score about the same, on 
‘the average, as the undergraduate students. Our groups may not 
_be large enough and our scale may not be sufficiently perfected to 
make these conclusions final. 


TABLE V 
DISPERSION OF ATTITUDE SCORES 
Standard 


Deviation 
of Scores 
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The several distributions represented in Figure 18 vary some- 
what in the dispersion of scores. In Table V the standard devia- 
tions are listed for the several distributions of scores on the experi- 
mental attitude scale. It will be seen that the dispersion of scores 
is approximately the same for the four undergraduate classes. The 
variability in attitude increases for the graduate students. The 
divinity students have the smallest scatter and the sample of 183 
records from the Chicago Forum shows the widest scatter in atti- 
tude toward the church. 

As a tentative application of the experimental scale, we have 
tabulated the frequency distributions for several groups which 
might conceivably differ in their attitudes toward the church. In 
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Figure 19 we have the distributions for Jews, Protestants, and 
Catholics. Inspection of the distributions shows immediately that 
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the Catholics are as a whole most strongly favorable toward the 
church. The Jews are as a whole more indifferent and more fre- 
quently antagonistic toward the church. The Protestants occupy 
an intermediate position on the scale. These results are probably 
what we should expect. The actual frequencies with the arith- 
metic mean for each distribution are summarized in Table VI. 
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It should be noted that in drawing these frequency distribu- 
tions we have reduced the areas of all the surfaces to unity. Each 
ordinate is therefore expressed in terms of relative frequency, i.e., 
the proportion of the whole distribution that is found in a class- 
interval. In this manner the sum of the relative frequencies for 
all the class-intervals must equal unity for each distribution. The 
purpose of this reduction is to facilitate the comparison of the dis- 


TABLE VI 
FREQUENCY DISTRIBUTIONS OF ATTITUDE TOWARD THE CHURCH 
» CHURCH Active CHuRcH- 
eihees TTENDANCE MEMBER 
INTERVAL MEN | WoMEN + 
Yes No 


Average 
scale- 
value... 


4.5180 | 4.1754 | 3.0560 | 5.9292 | 3.0886 | 5.6588 


tributions as to relative range and the location of the central tend- 
ency. If the distributions were drawn with the actual frequencies, 
they would of course be different in average height owing to the 
variation in the total number of cases in the several distributions. 
This might be a distraction in the inspection and comparison of 
the diagrams. The actual frequencies, are, however, presented in 
Table VI. In each of these frequency diagrams the arithmetic 
mean is represented by a small arrow on the base line. Its numer- 
ical value will be found in Table VI. 

_In Figure 20 we have a graphical comparison of men and 
women. These two frequency surfaces have been drawn in the 
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same manner as the preceding diagram. The spread is comparable 
for men and for women. The arithmetic means indicate that on 
the whole perhaps the women are slightly more favorable to the 
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church than the men. The present distributions are drawn prima- 
rily in order to illustrate the manner of using an attitude scale. 

On the title page of the printed form of the experimental scale 
we asked each subject whether or not he attended church fre- 
quently. The subjects who answered this question were divided 
into two groups according to whether their answer to this question 
was “yes” or ‘“‘no.”” These two distributions of attitude are shown 
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in Figure 21. The two groups are comparable in size. It will be 

_seen that there is a rather striking difference in the mean scale 
position of those who attend church frequently and of those who 
do not. This is, of course, as one would expect. 


40 


Church attendance: No” 
N=692 


20 


[efe) 


Church ottendance: “Yes 


Ao 
N= 678 

> 
Ss 
S 
Q 
& 

20} 
g 
oN 
x 
Ky 
y 

ee / 2 3 4 Ss 6 7 a =) 10 i 


Attifude sca/se 
Fic. 21 


A similar difference is seen in Figure 22 between the attitudes 
of those who are active church-members and those who are not. 
These frequency distributions reveal nothing that would not be 
expected beforehand, but they indicate at least that the scale does 
not give absurd results when applied to situations about which we 
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can make a reasonable prediction. If the scale gives reasonable re- 
sults in those groups whose attitudes toward the church are known 
beforehand it is a fair inference that the same scale might be used 
with some assurance in measuring the attitudes of groups about 


which we cannot make predictions. 
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The validity of the unit of measurement for the attitude scale 
is not demonstrated by these frequency distributions. It is con- 
ceivable that results as differentiating as these might be obtained 
even if the scale consisted of nothing more than a series of state- 
ments arranged in rank order and numbered serially. To es- 
tablish the validity of the unit of measurement is one of the most 
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important problems in the measurement of attitude. It can be 
‘done perhaps best by asking two groups of individuals who are 
known to differ in their attitude-on the issue in question to sort a 
series of one hundred or more statements into the eleven piles. 
The scale-values should be ascertained independently for the two 

_ groups. Now if the two scales so produced give substantially the 
same scale-values for the statements, then we shall have experi- 
mental evidence that the attitudes of the people who sort the 
statements have a negligible effect on the scale itself. Such an ex- 
periment is now under way. 

The method of equal-appearing intervals is used here not with- 
out realizing its limitations. It has been used in the measurement 
of handwriting excellence and of other educational products with- 
out admission by the authors that the scale-values so obtained 
might not be valid. It is likely that the scale-values are somewhat 
less valid than those obtained by the method of paired comparison 
or its equivalent. I know of no published study of the discrepan- 
cies in scale-values of educational products calculated by the two 
methods. Some crucial experiments to determine the validity of 

the method of equal-appearing intervals are now under way in the 
psychological laboratory of the University of Chicago. 


ALTERNATIVE FORMS OF THE FREQUENCY DISTRIBUTIONS 


One of our principal objectives in the measurement of attitude 
is to plot a frequency distribution of attitude which shall be de- 
scriptive of a group. A high ordinate of such a frequency distribu- 
tion should indicate that the attitude represented by that part of 
the scale is relatively popular in the group in question and, simi- 
larly, a low ordinate should indicate that the attitude represented 
by that part of the scale is relatively unpopular in the particular 
group. 

There are at least two different methods by which these fre- 
quency distributions may be plotted, and they are both illustrated 
in Figure 23 for the same group and for the same scale. It is of 
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course possible to tabulate a frequency distribution of scores and 
to represent this distribution graphically. This is shown in the 
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upper part of Figure 23. The area of such a diagram represents 
the total number of individuals in the group, and the ordinate for 
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any particular class-interval represents the actual number of in- 
dividuals whose scores fall in that class-interval. The interpreta- 
tion of such a frequency polygon is relatively simple. 

Another method is to calculate the average number of in- 
dorsements per statement in each class-interval and to plot a dis- 
tribution with these values as ordinates. The area of such a fre- 
quency diagram will be proportional to the number of indorse- 
ments made by the whole group to all of the statements in the 
scale if the opinions in the scale are evenly graduated. This type 
of distribution is shown in the lower part of Figure 23 for the same 
group and for the same scale. 

The numerical values from which the two diagrams of Figure 
23 were plotted are shown in Table VII. In the first column are 
recorded the scale values of the respective statements. In the sec- 
ond column are listed the code numbers of the statements. The 
third column shows the total number of indorsements for each of 
the statements in a group of 203 University of Chicago Freshmen 
whose papers were drawn at random from the total of 348 records 
specially for the purpose of comparing these two types of fre- 
quency distributions. For example, the first line of Table VII 
shows that statement 31 has a scale value of 0.2 and that it was 
given 50 indorsements by the present group of 203 freshmen. The 
first entry in the fourth column shows that the average number of 
indorsements per statement in the first class-interval was 64.4. It 
is merely the average of the entries 50, 61, and 82. The second 
entry of the last column shows that there were 20 students in the 
present group whose scores on the scale were between 1 and 2. 
The rest of the table is interpreted in the same manner. The upper 
part of Figure 23 is plotted directly from the last column of Table 
VII, and the lower diagram is plotted from the entries in the 
fourth column of the table. 

It would seem that either of these two methods of drawing the 
frequency distribution of attitude might be justified. One of them 
shows the frequency distribution of individual scores with a total 
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TABLE VII 


ScALING RECORD FOR A GROUP OF 203 UNIVERSITY 
oF CHICAGO FRESHMEN 
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TABLE VII—Continued 
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area equal to the number of individuals in the group. The other 
shows the average relative popularity of the statements in each 
class-interval. The total area of this surface is proportional to the 
total number of indorsements when the statements are exactly 
evenly graduated on the scale. 

It is clear that the spread of the lower diagram must be greater 
than the upper diagram of scores because statements may be in- 
dorsed even when they are too extreme to constitute any person’s 
score. It is our present belief that the upper diagram shows the 
preferable way of representing the distribution of attitude in a 
group. It is perhaps the simpler to explain or to interpret. It is 
merely the frequency distribution of scores on an attitude scale. 


CORRELATION BETWEEN THE ATTITUDE SCORES AND 
SELF-RATINGS 


On the title page of the experimental attitude scale we inserted 
a graphic rating scale. This scale consists merely of a horizontal 
line across the page on which we asked the subject to indicate by 
a cross where he estimated his own attitude to be. At one end of 
this line was printed the phrase, “Strongly favorable to the 
church”; at the middle of the line was printed the word ‘‘Neu- 
tral”; and at the other end of the line there was the phrase 
“Strongly against the church.”’ Not enough instruction was given 
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in the use of a self-rating scale to make this record of much conse- 
quence, but we included it for what it might be worth. 

When the papers were scored for the attitude scale a record 
was also made of the tenth of the horizontal line in which the sub- 
ject had placed a cross to indicate where he estimated his own 
attitude to be. It is of course to be expected that there should be 
correlation between the score on the attitude scale and the posi- 
tion of the check mark or cross on the self-rating line. The corre- 
lation between the score on the attitude scale and the tenth of the 
line in which the self-rating check occurred was found to be 0.67, 
which is fairly satisfactory. 

We have no estimate of the reliability of these self-ratings and 
consequently we cannot make any significant inference from this 
correlation. Any interpretation would also be subject to the ambi- 
guity that this correlation may be called an index of the validity 
of the attitude scale in terms of the self-ratings as a criterion, or 
it may be called an index of the validity of the self-ratings in 
terms of the attitude scale as a criterion. In either case, taken at 
its worst, the correlation between these two indices is closer than 
the correlation between most psychological tests and their re- 


spective criteria. It was frequently found that a subject would | 


rate himself as “neutral” on the self-rating line and check most of 
the statements strongly against the church in the attitude scale. 
This happened very frequently. In fact we believe we are justified 
in our inference that a subject will usually call himself slightly 
more favorable to the church than is indicated by the actual 
statements that he indorses. Perhaps this is because of the social 
pressure against the outspoken denial of the institutions that most 
people hold in high respect. It may also be that some of our sub- 
jects failed to understand the scale and interpreted “neutral” to 
mean complete or active indifference to the church. 


SUMMARY OF APPLICATIONS 


The practical application of the present measurement tech- 
nique consists in presenting the final list of statements of opinion 
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to the group to be studied with the request that they check with 
plus signs all the statements with which they agree and with minus 
signs all the statements with which they disagree. The score for 
each person is the average scale-value of all the statements that 
he has indorsed. In order that the scale be effective toward the 
extremes, it is advisable that the statements in the scale be ex- 
tended in both directions considerably beyond the attitudes which 
will ever be encountered as mean-values for individuals. When 
the score has been determined for each person by the simple sum- 
mation just indicated, a frequency distribution can be plotted for 
the attitudes of any specified group. 

The reliability of the scale can be ascertained by preparing 
two parallel forms from the same material and by presenting both 
forms to the same individuals. The correlation between the two 
scores obtained for each person in a group will then indicate the 
reliability of the scale. Since the heterogeneity of the group af- 
fects the reliability coefficient, it is necessary to specify the stand- 
ard deviation of the scores of the group on which the reliability 
coefficient is determined. The standard error of an individual 
score can also be calculated by an analogous procedure. 

The unit of measurement in the scale when constructed by the 
procedure here outlined is not the standard discriminal error pro- 
jected by a single statement on the psychological continuum. 
Such a unit of measurement can be obtained by the direct ap- 
plication of the law of comparative judgment, but it is consider- 
ably more laborious than the method here described. The unit in 
the present scale is a more arbitrary one, namely, one-eleventh of 
the range on the psychological continuum which covers the span 
from what the readers regard as extreme affirmation to extreme 
negation in the particular list of statements with which we start. 
Of course the scale-values can be determined with reliability to 
fractional parts of this unit. It is hoped that this unit may be 
shown experimentally to be proportional to a more precise and 
more universal unit of measurement, such as the standard dis- 
criminal error of a single statement of opinion. 
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It is legitimate to determine a central tendency for the frequen- | 


cy distribution of attitudes ina group. Several groups of individu- 
als may then be compared as regards the means of their respective 
frequency distributions of attitudes. The differences between the 
means of several such distributions may be directly compared be- 
cause of the fact that a rational base line has been established. 
Such comparisons are not possible when attitudes are ascertained 
merely by counting the number of indorsements to separate state- 
ments whose scale differences have not been measured. 

In addition to specifying the mean attitude of each of several 
groups, it is also possible to measure their relative heterogeneity 
with regard to the issue in question. Thus it will be possible, by 
means of our present measurement methods, to discover for ex- 
ample that one group is 1.6 more heterogeneous in its attitudes 
about prohibition than some other group. The heterogeneity of a 
group is indicated perhaps best by the standard deviation of the 
scale-values of all the opinions that have been indorsed by the | 
group as a whole rather than by the standard deviation of the dis- 
tribution of individual mean scores. Perhaps different terms | 
should be adopted for these two types of measurement. 

The tolerance which a person reveals on any particular issue is 
also subject to quantitative measurement. It is the standard devi- 
ation of the scale-values of the statements that he indorses. The 
maximum possible tolerance is, of course, the indorsement of all _ 
the statements throughout the whole range of the scale. 

If it is desired to know which of two forms of appeal is the 
more effective on any particular issue, this can be determined by 
using the scale before and after the appeal. The difference be- 
tween the individual scores, before and after, can be tabulated 
and the average shift in attitude following any specified form of 
appeal can be measured. 

The essential characteristic of the present measurement meth- 
od is the scale of evenly graduated opinions so arranged that equal 
steps or intervals on the scale seem to most people to represent 
equally noticeable shifts in attitude. 
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CHAPTER VI 
FURTHER STUDIES OF VALIDITY 


In the previous chapter we have already referred to the use of 
the information obtained from the first page of the test form. 
These data have been shown to have value in establishing both 
the reliability and validity of the scale. They will now be further 
examined to show their significance in the interpretation of the 
results obtained from our objective measurement of several 


- groups. This double check is of special value when the scale is to 


be used as a basis of educational program or guidance. The free 
statements made by each subject on the first page of his blank are 
useful in the interpretation of the frequency distributions. 

These free statements of attitude have also been carefully 
studied and are being used in the revision of the scale. The atti- 
tude variable will be more specifically defined. The title of the 
scale will probably read, “Attitude toward the Best Type of 
Church I Know.” Experience with the first scale suggests this 
change in statement and the revision will undoubtedly aid in 
making a more accurate diagnostic instrument. 

On the first page of the blank there were two questions: ‘“‘Do 
you attend church frequently?” and ‘‘Are you an active member 
of a church?” Each person was asked before checking the state- 
ments of the scale to write a brief statement of his own attitude 
toward the church. In answer to the first question 50.2 per cent 
of the Freshmen, 36.7 per cent of the Sophomores, 42.7 per cent 
of the Juniors, 45.2 per cent of the Seniors, and 46 per cent of the 
graduates said they attended church frequently. In response to 
the second question, the percentages of the groups who said they 
were active members were: Freshmen, 38.2 per cent; Sophomores, 
28.1 per cent; Juniors, 36.0 per cent; Seniors, 37.5 per cent, and 
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graduates, 40.2 per cent. In each case there is a distinct drop in 
percentage from the Freshmen class to the Sophomore class but 
an increase in percentage from the Sophomore group to the grad- 
uates. The largest percentage of frequent attendance is in the 
Freshmen group, but the largest percentage of active members is 
in the graduate group. The graduate group was composed chiefly 
of classes in the law, medical, and psychological departments. The 
undergraduate groups were of wider samplings. 
TABLE VIII 
RELATION BY SCORES AND ANSWERS 


SCALE PosITION OF SCALE PosITION © 
STUDENTS 0-5 .0 STUDENTS §.I-I0 
(FAVORABLE END oF SCALE)|(ANTICHURCH END OF Sear) 
Yes No Yes No 
Attend church frequently: 
Preshiien. sf: alates egg aranalaye 46.9% 16.7% 3.3% 33.1% 
SOPHOMOTE i... See eae Boat 24.2 4.6 39.1 
PLOY A Lith en eee eR 38.8 20.4 2.9 37-9 
Senlorecha ices ahora eae 42.3 19.2 2.9 35.6 
Graduate: earn neat fetes 40.2 19.6 ey Sas 
Active members 
Preshinen sy. Piaictas eaters mettre 35-3 28.3 3.0 33.4 
SGpnOMOre ney Vihar) ele eno ee 23.4 32.8 ART 39-1 
Hb beh ov paeee yy eRe OBAMA Ooch Teen 22..0 ROO 3.9 36.9 
Seniors: 8 can cece nee ete ae 34.6 26.9 2.9 35.6 
Graduate) cea Ae ete at: 34.9 24.9 Gate! 34.9 


Table VIII indicates the relation between the scores on the 
test and the answers to the two foregoing questions. On the aver- 
age it was nearly ten to one that if a person voted “‘yes”’ on either 
question of frequent attendance or active membership his scale 
position would be found in the favorable half of the scale. How- 
ever, a considerable number who are rated in the antichurch half 
of the scale indicated the habit of frequent attendance and active 
membership in the church. 

Students rated in every part of the scale showed appreciation 
of the church as an institution in society. Only a few gave un- 
qualified approval or disapproval. Nearly all marked shortcom- 
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ings of the church. The range of statements on the scale indorsed 
by members of each group, as indicated by the graphs, was wide, 
‘but there were few at the extremes. Likewise in the written state- 
ments on the first page a few manifest blind loyalty, bitter prej- 
udice, or careless superficiality, but the majority of the students 
show that they have considered relationship to the church in a 
serious way. Few seem to indicate any dogmatic or intolerant at- 
titude. Many apparently have had little acquaintance with mod- 
ern, progressive churches, and their attitudes are colored by un- 
fortunate experiences with conservative and intolerant religious 
persons and churches. 

Such statements as the following reveal the reason for sharp 
criticisms. They show the type of churches that the students have 
attended or from which their impressions have come. These state- 
ments are given in the students’ own words: 

Most churches follow a definite, unchangeable creed which is not prac- 
ticable in the changing age. 

The church is medieval, too slow to keep pace with modern thought. 

The church is hopelessly backward in rational thinking. 

I think most of the church doctrines are absurd and only good for emo- 
tional and ignorant people. 

I have found too much hypocrisy, prejudice, fear of God and hell, and 
too little of human fellowship in the church. 


One professor seems to have had only experience of reactionary 
groups for he says: “I regard the church as hopelessly allied with 
reaction. The leaders are chiefly trained in antiquities. Even if 
they have progressive inclinations they shape their teachings to 
the more reactionary elements in their congregations.’’ One stu- 
dent frankly confesses: “I am afraid a lack of experience with the 
church makes me prejudiced against it.” 

The students on the average had definite attitudes toward 
churches in general and their statements and marking show the 
color of their experiences. But many showed that they differen- 
tiated between churches and though some of their experiences had 
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been unhappy ones they had discovered satisfying religious 
groups, practices, and beliefs. One student said: “I have taken a 
religious course at the university this quarter and it has meant. 
more to me than any church in attaining the religious spirit. I) 
have learned to think of religion in a bigger way than the churches 
teach.”’ Another said: “TI have been prejudiced against the church: 
by early training but am beginning to have a new value for the: 
church for I am coming to know different kinds of churches.” 
Another said: ‘‘I believe the more modern churches are trying to 
meet human needs.”’ And a professor confessed: ‘Toward most 
churches I have only a feeling of impatience at their misplaced 
emphases and their distorted values, but for such a local church as 
the one I attend here I have great admiration because of its con- 
structive idealism, though I do not agree with all I hear.” 

The number of hearty indorsements of the church was rather 
surprisingly large and was well distributed among men and 
women, and across the different religious groupings, Protestant, 
Roman Catholic, and Jewish. Consider the following as frequent 
samples: 

I thoroughly believe in the church and I think a great effort is being 
made to interpret the fundamental principles of religion in the light of our 
changing modern life. 

I regard the church as the most potent factor in civilization today. 

I believe in the church and want to do my part. In spite of its inadequate 
adaptation to social conditions I am convinced that it is one of the most con- 
structive agencies in society and is in a process of evolution. 

The church has had a most important influence in my life. I obtain help 


from the church I cannot get elsewhere. 
I find my finest friendships in the church. 


Of course there were many platitudes and patronizing com- 
ments, as: 

I think it is a wonderful institution. 

I believe the church is a benefit. 


I am strongly favorable to the church. 
I’m for the church. 
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It is O.K. 
It is a fine thing. 


There were a few in each class who showed careless super- 
ficiality in their expression of opinion, as such statements as these 
indicate: 

I have never taken church attendance seriously. 

I know too little about the church to express an opinion. 

I go to church on holidays. 

I go to hear special speakers. 

I haven’t time for the church. 

I go to church because I am accustomed to go but I don’t know a thing 
about religion. 


A secret longing for greater assurance as to the realities of 
religion seems to be implied in some of the responses. Some are 
impatient with the failure of the church to live up to its ideals. 
Some who have taken religion and the church for granted, with- 
out thinking through beliefs and practices, have been’ challenged 
for the first time. Consider the following expressions of opinion: 

I am confused in my religious ideas but have never had any help from a 
church. What beliefs I have I’ve had to work out for myself. 

I believe in God but de not find any satisfaction in the church. 

I seldom go to church but I pray every day. 

I am really religiously inclined but rebel against the narrowness of the 
church. 

I believe in Christianity but it seems to me that denominationalism ob- 
scures it. 

I believe in Christianity but do not thmk the church is at all willing to 
follow the revolutionary teachings of Jesus. 

I am a strong evolutionist and can scarcely agree with the church and 
its doctrines. 

I am an atheist but am not against the church. 

I do not go to church because the church today seems too far behind the 
times and too narrow-minded to suit me. 

Mere attendance and ceremony mean nothing if a church’s teachings are 
not applicable to daily life in all its phases. 

I believe I have to make the best religion I can without the aid of a 
church. 
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Although I do not attend church regularly, I believe in a personal God 
and consider myself religious. 

I'd give up the doctrines and creeds of the church for something simple 
—the symbol of Good. 


The variety of criticism against the church is interesting. It 
shows what a difficult task the church has to satisfy all the dif- 
ferent kinds of people with different backgrounds, needs, desires, 
and ideas. Take the following for illustration of student criticism: 


Ninety per cent of churchgoers want to be spoon-fed instead of thinking 
for themselves. 

The church is hypocritical, superficial, and meddles in things that do not 
concern it. 

There are too many petty quarrels in the church. 

The church is all right, but it could be made a lot more interesting. 

It is a waste of time to go to church unless the minister is a man of 
superior ability. 

I have gone to church and Sunday school a lot in my time but have found 
it unsatisfying and so do not now attend. 

The church sanctions un-Christlike activities like war. 

The church is a part of the capitalistic scheme to keep people down. 

I like the social life of the church but I cannot believe in Christian theol- 
ogy, the divinity of Christ, or a personal God. 

I dislike the forms of Christianity. It would be pleasant to believe in 
some less credulous mysticism. 

I am indifferent to the church. Most are social clubs whose members 
would be horrified if they were required to in any way approximate the re- 
volutionary teachings of their alleged leader. I believe in Christianity but the 
church is not its representative. 

I do not attend church because of the prevalent hand-shaking system. 


The foregoing analysis indicates various factors that need at- 
tention if the attitudes of an individual or of a group are to be 
changed. When a series of scales is developed for measuring reli- 
gious attitudes, they will give valuable information about the at- 
titudes of a group, ' 

The instrument and the methods of its production which we 
have described offer a pattern for the construction of other scales 
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to measure other religious attitudes. A battery of such tests would 
serve to give a most worth-while diagnosis of any group with which 
a religious educator was working and to measure the results of 
the processes used. Other attitude scales might be developed, 
such as those relating to the function of the idea of God in the con- 
trol of conduct; the value of prayer; the observance of Sunday, 
_ and the significance of a belief in immortality. 


CHAPTER VII 


SOME FURTHER PROBLEMS IN THE MEASURE- 
MENT OF ATTITUDE 


AN ALTERNATIVE METHOD OF CONSTRUCTING THE ATTITUDE 
SCALE 

In the present experiment the scale values of the opinions were 
determined by what we may call the sorting method. It is a varia- 
tion of the method of equal-appearing intervals of psychophysics. 
Several hundred subjects sort out the statements into eleven piles 
which seem to them to be equally spaced on a subjective contin- 
uum from extreme pro to extreme anti on the issue in question. 
This procedure requires the participation of a large group of sub- 
jects who during the sorting do not express their own attitudes but 
merely sort the statements into successive equal-appearing inter- 
vals according to the meaning that the statements imply to the 
readers. Later, when a group is to be studied by means of the 
scale, the subjects actually vote on the statements in accordance 
with their own convictions and attitudes. 

We shall mention here in passing the possibility of determining 
the scale-values of the statements without the rather laborious 
sorting process. It may be possible to scale the statements direct- 
ly from the voting records of a large group of subjects provided 
that a considerable range of attitudes is represented in the group 
of subjects used for this purpose. The principle involved is that if 
two statements are close together on the scale, then the people 
who vote for one of them should be quite likely to vote for the 
other one also. If the statements are very different, spaced far 
apart on the scale, then those who vote for one of the statements 
should not be very likely to vote for the other one also. 

It might be possible to reverse this reasoning. We might then 
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be able to infer the scale separation between two statements in 
terms of the number of subjects who indorse both statements, 
Mz2, the number who indorse the first, ”,, and the number who 
indorse the second, 7. It is certain that the intrinsic popularity 
of a statement must be taken into consideration because two 
_ statements may belong to the same point on an attitude scale and 
_yet differ widely in the relative frequency with which they are in- 
dorsed. This factor of relative popularity is accounted for by the 
total number of subjects who indorse each statement. 

The index of similarity that we have described for the criterion 
of irrelevance incorporates these three factors in a rather crude 
way. In a later publication we hope to describe a procedure for 
scaling opinions directly from the records of voting and, if the 
procedure shows satisfactory internal consistency of the data, the 
sorting method here described may be superseded. The sorting 
method rests on fewer assumptions that can be questioned, as far 
as we Can see now, and it was therefore chosen for our first experi- 
ments in the measurement of attitude. 


THE VALIDITY OF THE SCALE 


The scale must transcend the group measured. One crucial ex- 
perimental test must be applied to our method of measuring atti- 
tudes before it can be accepted as valid. A measuring instrument 
must not be seriously affected in its measuring function by the ob- 
ject of measurement. To the extent that its measuring function is 
so affected, the validity of the instrument is impaired or limited. 
If a yardstick measured differently because of the fact that it was 
a rug, a picture, or a piece of paper that was being measured, 
then to that extent the trustworthiness of that yardstick as a 
measuring device would be impaired. Within the range of objects 
for which the measuring instrument is intended, its function must 
be independent of the object of measurement. 

We must ascertain similarly the range of applicability of our 
method of measuring attitude. It will be noticed that the con- 
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struction and the application of a scale for measuring attitude are 
two different tasks. If the scale is to be regarded as valid, the 
scale values of the statements should not be affected by the opin- 
ions of the people who help to construct it. This may turn out 
to be a severe test in practice, but the scaling method must stand 
such a test before it can be accepted as being more than a descrip- 
tion of the people who construct the scale. At any rate, to the 
extent that the present method of scale construction is affected by 
the opinions of the readers who help to sort out the original state- 
ments into a scale, to that extent the validity or universality of 
the scale may be challenged. 

Until experimental evidence may be forthcoming on this point, 
we shall make the assumption that the scale-values of the state- 
ments are independent of the attitude distribution of the readers 
who sort the statements. The assumption is, in other words, that 
two statements on a prohibition scale will be as easy or as difficult 
to discriminate for people who are ‘‘wet’’ as for those who are 
“dry.”” Given two adjacent statements from such a scale, we as- 
sume that the proportion of ‘‘wets’’ who say that statement A 
is wetter than statement B will be substantially the same as the 
corresponding proportion for the same statements obtained from 
a group of “‘drys.”’ Restating the assumption in still another-way, 
we are saying that it is just as difficult for a strong militarist as it 
is for a strong pacifist to tell which of two statements is the more 
militaristic in attitude. If, say, 85 per cent of the militarists de- 
clare statement A to be more militaristic than statement B, then, 
according to our assumption, substantially the same proportion 
of pacifists would make the same judgment. If this assumption is 
correct, then the scale is an instrument independent of the atti- 
tude which it is itself intended to measure. 

The experimental test for this assumption consists merely in 
constructing two scales for the same issue with the same set of 
statements. One of these scales will be constructed on the returns 
from several hundred readers of militaristic sympathies and the 
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other scale will be constructed with the same statements on the 
returns from several hundred pacifists. If the scale values of 
the statements are practically the same in the two scales, then the 
validity of the method will be pretty well established. It will still 
be necessary to use opinion scales with some discretion. Queer re- 
sults might be obtained with the prohibition scale, for example, if 
it were presented in a country in which prohibition is not an issue. 


TWO POSSIBLE TYPES OF ATTITUDE SCALE 


The present experiments have been confined to one type of 
attitude scale. When we started to solve this problem of measur- 
ing attitude we found that the scale could logically be constructed 
along either one of two rather different lines. One of these types 
was chosen as preferable and the decision was probably correct 
as far as one can tell as yet. For certain kinds of attitude material 
it is conceivable that the alternative type of scale would be the 
preferable. 

The two types are illustrated by the two hypothetical dia- 
grams of Figure 24. The upper diagram represents the type of 
scale with which we have here been working. The ordinates rep- 
resent the probability of indorsement of a statement while the 
base line is the scale itself. The interpretation is that any particu- 
lar statement is most likely to be indorsed by the people who are 
scaled at the median of the distribution of indorsements for the 
statement. In other words, as we proceed from one end of the 
scale to the other by class-intervals, the probability of indorse- 
ment for any particular statement increases to a maximum and 
then decreases again to zero, as shown in the diagram. 

Statements differ in intrinsic popularity as shown by the fact 
that the two hypothetical curves in the upper part of Figure 24 
are of unequal area. Even if a statement and a person are scaled 
at the same point on the scale, it does not therefore follow that the 
person will necessarily indorse that statement. But when this con- 
dition obtains, then the probability is a maximum that the state- 
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ment will be indorsed. The probability of indorsement of this 
particular statement is lower for people in other class-intervals 
than the one in which the statement is allocated. This type of 
attitude scale may be called the maximum probability type. 


Maximum probobility type of scale 


Probability of erdorserrert 


Attitude scale 


Increasing probability lype of scale 


Frobability of endorsement 


Attitude  sca/e 


Fic. 24 


The alternative form of scale is shown in the hypothetical dia- 
gram of the lower part of Figure 20. It is best illustrated by one 
or two examples. Let us suppose that the issue in question is the 
desirability of capital punishment. Let the base line represent a 
series of crimes ranging from minor offenses at the left end of the 
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scale to the most serious crimes imaginable at the right end of the 
scale. Let us also assume that these crimes have been allocated to 
the continuum by sorting on the basis of relative seriousness. 
Now if we asked the subjects to check each crime in the list which 
they consider serious enough to deserve capital punishment, we 

should expect to find that as the seriousness of the crime increases 
_ the probability of checking for capital punishment would also 
increase. Very likely the proportion of such judgments would be 
zero for the minor offenses. It would rise as the seriousness of the 
offenses rises but there would be no maximum. The curve would 
_ be asymptotic probably to the level of unity. If some subjects 
refuse absolutely to indorse any crimes for capital punishment, 
then the curve will approach unity but will not reach it. It is also 
possible that the curve will approach a level below unity. It will 
not again fall because if the group indorses capital punishment for 
a crime of a specified degree of seriousness, certainly we expect the 
same group to indorse capital punishment just as often, or pos- 
sibly more often, for all crimes that they judge to be more serious. 
On account of this characteristic we have called this type of scale 
the increasing probability type. 

Another example of the same type of scale with a different 
sort of base line can be thought of for the prohibition question. 
Suppose that the base line represents the percentage of alcohol 
that should be allowed. The curve for such a scale would begin 
supposedly at unity and it would fall toward the base line if the 
X-scale is one of increasing percentage of alcohol. This is clear be- 
cause any one who indorses, let us say, 10 per cent of alcohol will 
almost certainly indorse a lower percentage as legally allowable. 
The scale-value and the Q-value of a statement so scaled would be 
determined by methods analogous to those already described. 

Still another example of this type of scale would be a list of 
justifiable provocations for war. Let us suppose that these provo- 
cations were listed in rank order of seriousness by the sorting 
method described. Now if each subject is asked to check those 


96 MEASUREMENT OF ATTITUDES 


provocations which he considers sufficiently serious or aggravat- 
ing to justify the declaration of war, then it is reasonable to ex- 
pect that the person who checks a relatively trivial cause as a 
suitable provocation for declaring war will also check the more 
serious situations in the same way. The resulting curve would be 
a rising probability curve which reminds one of the integral of a 
frequency distribution which may or may not be normal or sym- 
metrical. 

It is possible that certain issues may lend themselves to meas- 
urement by the increasing probability type of scale but it is prob- 
able that most issues will be better described if the scale is inten- 
tionally constructed so that a person is more likely to indorse the 
opinions at some one part of the scale than at any other part. 
Such a scale is the maximum probability type. 
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